[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:54 dist-test-slave-gjrz krb5kdc[13009](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:54 dist-test-slave-gjrz krb5kdc[13009](info): set up 2 sockets
Aug 12 11:20:54 dist-test-slave-gjrz krb5kdc[13009](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 11:20:55.782264 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:20:55 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:20:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:20:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:20:55.895349 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45629
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:45629
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:55.999914 13030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:56.000145 13030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:56.000198 13030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:56.004051 13030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:56.004096 13030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:56.004120 13030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:56.004142 13030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:56.004169 13030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:56.009056 13030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:45629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:56.009943 13030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:56.010900 13030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:56.018930 13052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.018941 13043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.018946 13046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.018976 13030 server_base.cc:1034] running on GCE node
I20260812 11:20:56.019665 13030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:56.020720 13030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:56.021871 13030 hybrid_clock.cc:648] HybridClock initialized: now 1786533656021826 us; error 120 us; skew 500 ppm
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:56.027398 13030 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:20:56.028216 13030 webserver.cc:460] Webserver started at http://127.12.175.254:35441/ using document root <none> and password file <none>
I20260812 11:20:56.028705 13030 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:56.028769 13030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:56.028944 13030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:56.030805 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "a1a1511089c482f35fc4b6fc91dc3a7d"
server_key_iv: "bdb35d21b959afe31ac9bce4a9b49995"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.031363 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "a1a1511089c482f35fc4b6fc91dc3a7d"
server_key_iv: "bdb35d21b959afe31ac9bce4a9b49995"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.034706 13030 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:20:56.037009 13063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.038204 13030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:20:56.038323 13030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "a1a1511089c482f35fc4b6fc91dc3a7d"
server_key_iv: "bdb35d21b959afe31ac9bce4a9b49995"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.038419 13030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:56.048198 13030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:56.050990 13030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:56.051167 13030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:56.057598 13030 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:45629
I20260812 11:20:56.057615 13166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:45629 every 8 connection(s)
I20260812 11:20:56.058440 13030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:56.060478 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13030
I20260812 11:20:56.060634 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:20:56.061412 13167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:56.062255 12991 external_mini_cluster.cc:1428] Setting key 8b8b7b3aa3eea8d975ee9cd6bbf61057
I20260812 11:20:56.067611 13167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2: Bootstrap starting.
I20260812 11:20:56.069608 13167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:56.070436 13167 log.cc:824] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:56.072326 13167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2: No bootstrap required, opened a new log
I20260812 11:20:56.076144 13167 raft_consensus.cc:348] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45629 } }
I20260812 11:20:56.076395 13167 raft_consensus.cc:374] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:56.076457 13167 raft_consensus.cc:729] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c35f04e5be2d4e3cb297ee1e5ff6f4d2, State: Initialized, Role: FOLLOWER
I20260812 11:20:56.076884 13167 consensus_queue.cc:260] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45629 } }
I20260812 11:20:56.077008 13167 raft_consensus.cc:388] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:56.077066 13167 raft_consensus.cc:482] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:56.077160 13167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:56.077922 13167 raft_consensus.cc:504] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45629 } }
I20260812 11:20:56.078222 13167 leader_election.cc:302] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c35f04e5be2d4e3cb297ee1e5ff6f4d2; no voters:
I20260812 11:20:56.078469 13167 leader_election.cc:288] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:20:56.078590 13175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:56.078805 13175 raft_consensus.cc:686] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [term 1 LEADER]: Becoming Leader. State: Replica: c35f04e5be2d4e3cb297ee1e5ff6f4d2, State: Running, Role: LEADER
I20260812 11:20:56.079118 13175 consensus_queue.cc:237] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45629 } }
I20260812 11:20:56.079674 13167 sys_catalog.cc:564] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:56.080267 13180 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c35f04e5be2d4e3cb297ee1e5ff6f4d2. Latest consensus state: current_term: 1 leader_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45629 } } }
I20260812 11:20:56.080395 13180 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:56.081025 13177 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35f04e5be2d4e3cb297ee1e5ff6f4d2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45629 } } }
I20260812 11:20:56.081138 13177 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2 [sys.catalog]: This master's current role is: LEADER
W20260812 11:20:56.084757 13201 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:20:56.084838 13201 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:20:56.084919 13190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:56.085780 13190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:56.086565 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.065868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51372 (local address 127.12.175.254:45629)
0812 11:20:56.066326 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.066344 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.067359 (+ 1015us) server_negotiation.cc:407] Connection header received
0812 11:20:56.070449 (+ 3090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.070471 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.070845 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.071105 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.073134 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.074599 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.075790 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.076463 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.076620 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.080952 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.080958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.080973 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.081001 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.082807 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.083445 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.083451 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.083456 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.083603 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.083987 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.083990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.083992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.084447 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.084660 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.085316 (+ 656us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.085634 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":147,"threads_started":1}
I20260812 11:20:56.090988 13190 catalog_manager.cc:1347] Generated new cluster ID: 3d143c97c4f94d49834bf8ca32071a11
I20260812 11:20:56.091048 13190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:56.096619 13190 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:56.097697 13190 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:56.102026 13190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c35f04e5be2d4e3cb297ee1e5ff6f4d2: Generated new TSK 0
I20260812 11:20:56.102662 13190 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:20:56.129949 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45629
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:56.254310 13213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:56.254534 13213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:56.254577 13213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:56.258492 13213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:56.258543 13213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:56.258600 13213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:20:56.263603 13213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45629
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:56.264505 13213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:56.265415 13213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:56.274288 13231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.274366 13213 server_base.cc:1034] running on GCE node
W20260812 11:20:56.274317 13227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.274318 13228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.274926 13213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:56.275566 13213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:56.276736 13213 hybrid_clock.cc:648] HybridClock initialized: now 1786533656276717 us; error 29 us; skew 500 ppm
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:56.279321 13213 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:20:56.280121 13213 webserver.cc:460] Webserver started at http://127.12.175.193:34261/ using document root <none> and password file <none>
I20260812 11:20:56.280699 13213 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:56.280776 13213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:56.280968 13213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:56.282914 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "4667c3ceba8e43369aa9fea12847f129"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "76bafbdbe533134aa1c7292f7a3a45d1"
server_key_iv: "c9760f55a099be9e5784399b70889518"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.283478 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "4667c3ceba8e43369aa9fea12847f129"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "76bafbdbe533134aa1c7292f7a3a45d1"
server_key_iv: "c9760f55a099be9e5784399b70889518"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.286810 13213 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:56.289001 13247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.290091 13213 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:20:56.290200 13213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "4667c3ceba8e43369aa9fea12847f129"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "76bafbdbe533134aa1c7292f7a3a45d1"
server_key_iv: "c9760f55a099be9e5784399b70889518"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.290288 13213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:56.299165 13213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:56.301543 13213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:56.301697 13213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:56.302208 13213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:56.302930 13213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:56.302975 13213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.303033 13213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:56.303061 13213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.311064 13213 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:45579
I20260812 11:20:56.311125 13474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:45579 every 8 connection(s)
I20260812 11:20:56.311827 13213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:56.315320 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13213
I20260812 11:20:56.315411 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:20:56.315667 12991 external_mini_cluster.cc:1428] Setting key 5c90d1f1cf1939608bed030550106ffb
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:56.325142 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.313499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:39943 (local address 127.12.175.254:45629)
0812 11:20:56.313625 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.313629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.314379 (+ 750us) server_negotiation.cc:407] Connection header received
0812 11:20:56.315601 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.315605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.315664 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.315740 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.316911 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.317630 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.318733 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.319060 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.319143 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.321754 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.321757 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.321759 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.321784 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.323105 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.323721 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.323724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.323725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.323804 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.324164 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.324166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.324167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.324327 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.324395 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.324936 (+ 541us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.325029 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:20:56.326151 13485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.313811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45629 (local address 127.12.175.193:39943)
0812 11:20:56.314247 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.314287 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.315382 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.315910 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.315917 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.316329 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:56.316772 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.316785 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.317750 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.317753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.318614 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.318624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.319220 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.319224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.319442 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.319949 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:56.319969 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:56.321590 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:56.323222 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.323229 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.323243 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.323607 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.323886 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.323889 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.323891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.324078 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.324422 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:56.324428 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:56.324714 (+ 286us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.324909 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.325226 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":113,"threads_started":1}
I20260812 11:20:56.327237 13482 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45629
I20260812 11:20:56.327455 13482 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:56.327863 13482 heartbeater.cc:511] Master 127.12.175.254:45629 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
I20260812 11:20:56.329313 13102 ts_manager.cc:194] Registered new tserver with Master: 4667c3ceba8e43369aa9fea12847f129 (127.12.175.193:45579)
I20260812 11:20:56.330371 13102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:39943
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:20:56.341822 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45629
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:56.446385 13491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:56.446596 13491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:56.446641 13491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:56.450449 13491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:56.450497 13491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:56.450572 13491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:20:56.455420 13491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45629
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:56.456274 13491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:56.457135 13491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:56.465801 13502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.465883 13504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.465802 13507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.466171 13491 server_base.cc:1034] running on GCE node
I20260812 11:20:56.466517 13491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:56.467079 13491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:56.468222 13491 hybrid_clock.cc:648] HybridClock initialized: now 1786533656468197 us; error 37 us; skew 500 ppm
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:56.470780 13491 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:20:56.473848 13491 webserver.cc:460] Webserver started at http://127.12.175.194:38581/ using document root <none> and password file <none>
I20260812 11:20:56.474324 13491 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:56.474378 13491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:56.474532 13491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:56.476413 13491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "69fd3b440e124c6b8ed8044557a3c3aa"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "ab6a4b269c91f506b05a4c37e17fcc8d"
server_key_iv: "3386780a95e262c0880d2237ead4e575"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.476893 13491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "69fd3b440e124c6b8ed8044557a3c3aa"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "ab6a4b269c91f506b05a4c37e17fcc8d"
server_key_iv: "3386780a95e262c0880d2237ead4e575"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.480281 13491 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:20:56.482472 13524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.483610 13491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:20:56.483708 13491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "69fd3b440e124c6b8ed8044557a3c3aa"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "ab6a4b269c91f506b05a4c37e17fcc8d"
server_key_iv: "3386780a95e262c0880d2237ead4e575"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.483798 13491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:56.507336 13491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:56.509781 13491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:56.509918 13491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:56.510427 13491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:56.511416 13491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:56.511466 13491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.511502 13491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:56.511521 13491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.519423 13491 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:37635
I20260812 11:20:56.519445 13721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:37635 every 8 connection(s)
I20260812 11:20:56.520183 13491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:56.527134 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13491
I20260812 11:20:56.527238 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:20:56.527500 12991 external_mini_cluster.cc:1428] Setting key 8140610cb6bbdf2c9a70661dcb55e6a7
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:56.532500 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.521728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:59251 (local address 127.12.175.254:45629)
0812 11:20:56.521859 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.521863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.522606 (+ 743us) server_negotiation.cc:407] Connection header received
0812 11:20:56.523871 (+ 1265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.523875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.523933 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.524002 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.525070 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.525580 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.526668 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.526885 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.526991 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.529280 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.529283 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.529285 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.529308 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.530573 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.531045 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.531048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.531050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.531142 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.531479 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.531482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.531484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.531705 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.531804 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.532242 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.532355 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:20:56.533116 13727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.522065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45629 (local address 127.12.175.194:59251)
0812 11:20:56.522470 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.522508 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.523678 (+ 1170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.524169 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.524175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.524492 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:56.524925 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.524937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.525695 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.525698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.526550 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.526559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.527025 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.527029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.527189 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.527688 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:56.527704 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:56.529131 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:56.530701 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.530705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.530716 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.530955 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.531219 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.531221 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.531223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.531395 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.531792 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:56.531796 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:56.532000 (+ 204us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.532144 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.532367 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":110,"threads_started":1}
I20260812 11:20:56.534200 13722 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45629
I20260812 11:20:56.534399 13722 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:56.534808 13722 heartbeater.cc:511] Master 127.12.175.254:45629 requested a full tablet report, sending...
I20260812 11:20:56.535806 13102 ts_manager.cc:194] Registered new tserver with Master: 69fd3b440e124c6b8ed8044557a3c3aa (127.12.175.194:37635)
I20260812 11:20:56.536550 13102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:59251
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:20:56.555323 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45629
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:56.659816 13734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:56.660019 13734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:56.660065 13734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:56.663842 13734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:56.663882 13734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:56.663935 13734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:20:56.668675 13734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45629
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:56.669459 13734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:56.670316 13734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:56.678910 13743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.678925 13744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.678964 13734 server_base.cc:1034] running on GCE node
W20260812 11:20:56.678920 13747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.679512 13734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:56.680073 13734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:56.681221 13734 hybrid_clock.cc:648] HybridClock initialized: now 1786533656681176 us; error 58 us; skew 500 ppm
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:56.684154 13734 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:20:56.684899 13734 webserver.cc:460] Webserver started at http://127.12.175.195:39115/ using document root <none> and password file <none>
I20260812 11:20:56.685389 13734 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:56.685453 13734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:56.685631 13734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:56.687577 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "e282d2c141f3481a8b9f529ad3e3a553"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "30bda4eb9ec05ab0011dd4b686e4a2a2"
server_key_iv: "23a6bf58bad9448e3fa47cd04e305fd8"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.688095 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "e282d2c141f3481a8b9f529ad3e3a553"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "30bda4eb9ec05ab0011dd4b686e4a2a2"
server_key_iv: "23a6bf58bad9448e3fa47cd04e305fd8"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.691479 13734 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 11:20:56.693712 13757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.694854 13734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:20:56.694952 13734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "e282d2c141f3481a8b9f529ad3e3a553"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-gjrz"
server_key: "30bda4eb9ec05ab0011dd4b686e4a2a2"
server_key_iv: "23a6bf58bad9448e3fa47cd04e305fd8"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.695051 13734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:56.722915 13734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:56.725461 13734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:56.725633 13734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:56.726166 13734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:56.726943 13734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:56.726987 13734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.727028 13734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:56.727058 13734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.735148 13734 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:33235
I20260812 11:20:56.735204 13947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:33235 every 8 connection(s)
I20260812 11:20:56.735991 13734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:56.740517 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13734
I20260812 11:20:56.740607 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:20:56.740823 12991 external_mini_cluster.cc:1428] Setting key 1a978ec1b4ea709a2b37fe9cacce8888
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:56.748693 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.737728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40801 (local address 127.12.175.254:45629)
0812 11:20:56.737847 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.737850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.738622 (+ 772us) server_negotiation.cc:407] Connection header received
0812 11:20:56.739861 (+ 1239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.739865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.739928 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.739997 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.741213 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.741828 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.743254 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.743506 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.743589 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.745760 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.745763 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.745765 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.745789 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.746859 (+ 1070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.747322 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.747326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.747327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.747403 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.747710 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.747714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.747716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.747887 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.747973 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.748422 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.748539 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:20:56.749365 13951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.738056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45629 (local address 127.12.175.195:40801)
0812 11:20:56.738474 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.738513 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.739633 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.740189 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.740195 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.740554 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:56.741054 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.741070 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.741991 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.741996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.743136 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.743147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.743639 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.743642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.743795 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.744251 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:56.744266 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:56.745615 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:56.746964 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.746970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.746983 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.747215 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.747487 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.747490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.747492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.747623 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.747987 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:56.747994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:56.748208 (+ 214us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.748362 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.748662 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":109,"threads_started":1}
I20260812 11:20:56.750310 13948 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45629
I20260812 11:20:56.750495 13948 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:56.750890 13948 heartbeater.cc:511] Master 127.12.175.254:45629 requested a full tablet report, sending...
I20260812 11:20:56.751781 13102 ts_manager.cc:194] Registered new tserver with Master: e282d2c141f3481a8b9f529ad3e3a553 (127.12.175.195:33235)
I20260812 11:20:56.752290 13102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:40801
I20260812 11:20:56.754694 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:20:56.779142 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.771327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52764 (local address 127.12.175.193:45579)
0812 11:20:56.771631 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.771639 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.771661 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:20:56.771705 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.771709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.771858 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.771966 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.772517 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.773251 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.773985 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.774321 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.774395 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.776519 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.776527 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.776539 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.776560 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.777784 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.778141 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.778145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.778146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.778216 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.778397 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.778399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.778400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.778597 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.778732 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.778880 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.778994 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":108,"threads_started":1}
W20260812 11:20:56.780128 13311 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52764
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:20:56.803146 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.796102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52770 (local address 127.12.175.193:45579)
0812 11:20:56.796204 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.796207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.796341 (+ 134us) server_negotiation.cc:407] Connection header received
0812 11:20:56.796426 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.796428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.796461 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.796521 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.797062 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.797524 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.798260 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.798472 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.798553 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.800541 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.800544 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.800546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.800566 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.801786 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.802237 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.802240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.802241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.802351 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.802572 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.802574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.802575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.802712 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.802798 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.802956 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.803043 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:20:56.803992 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13213
I20260812 11:20:56.824452 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13491
I20260812 11:20:56.836570 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13734
I20260812 11:20:56.856287 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13030
2026-08-12T11:20:56Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2288 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13968](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13968](info): set up 2 sockets
Aug 12 11:20:56 dist-test-slave-gjrz krb5kdc[13968](info): commencing operation
krb5kdc: starting...
W20260812 11:20:58.037509 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:20:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:20:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:20:58.149762 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:40285
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:40285
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:58.255380 13985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:58.255595 13985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:58.255631 13985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:58.259433 13985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:58.259478 13985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:58.259495 13985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:58.259511 13985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:58.259539 13985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:58.264487 13985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:40285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:40285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:58.265347 13985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:58.266232 13985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:58.273880 14000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:58.273891 14006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:58.274044 13985 server_base.cc:1034] running on GCE node
W20260812 11:20:58.273890 13998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:58.274653 13985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:58.275640 13985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:58.276808 13985 hybrid_clock.cc:648] HybridClock initialized: now 1786533658276779 us; error 38 us; skew 500 ppm
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:58.279377 13985 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:20:58.280197 13985 webserver.cc:460] Webserver started at http://127.12.175.254:33557/ using document root <none> and password file <none>
I20260812 11:20:58.280689 13985 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:58.280752 13985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:58.280927 13985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:58.282771 13985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "5214562cdda0462ab1f94a8c9cb00c7a"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "052c9a12918e096a3c793ba570cbe2a2"
server_key_iv: "b925010e4ba0ad66e6d732808bb57c08"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.283303 13985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "5214562cdda0462ab1f94a8c9cb00c7a"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "052c9a12918e096a3c793ba570cbe2a2"
server_key_iv: "b925010e4ba0ad66e6d732808bb57c08"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.286643 13985 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:20:58.288818 14017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.289882 13985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:20:58.289989 13985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "5214562cdda0462ab1f94a8c9cb00c7a"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "052c9a12918e096a3c793ba570cbe2a2"
server_key_iv: "b925010e4ba0ad66e6d732808bb57c08"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.290076 13985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:58.304733 13985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:58.307556 13985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:58.307709 13985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:58.313958 13985 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:40285
I20260812 11:20:58.313970 14110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:40285 every 8 connection(s)
I20260812 11:20:58.314791 13985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:58.314989 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13985
I20260812 11:20:58.315083 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:20:58.315358 12991 external_mini_cluster.cc:1428] Setting key 2f06b038bba423401653118f5ae1c888
I20260812 11:20:58.317619 14114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:58.322785 14114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a: Bootstrap starting.
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:58.325109 14114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:58.325814 14114 log.cc:824] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:58.327762 14114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a: No bootstrap required, opened a new log
I20260812 11:20:58.328189 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.316652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56760 (local address 127.12.175.254:40285)
0812 11:20:58.317078 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:58.317093 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:58.317127 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:20:58.317727 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:58.317750 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:58.318080 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:58.318369 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:58.319118 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.320146 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.320961 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.321411 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.321552 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.323998 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:58.324003 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:58.324015 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:58.324040 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:58.325552 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.326020 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.326025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.326029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.326136 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.326405 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.326408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.326409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.326792 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:58.326927 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:58.327208 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 11:20:58.327501 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":147,"threads_started":1}
I20260812 11:20:58.331238 14114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40285 } }
I20260812 11:20:58.331467 14114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:58.331524 14114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5214562cdda0462ab1f94a8c9cb00c7a, State: Initialized, Role: FOLLOWER
I20260812 11:20:58.331944 14114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40285 } }
I20260812 11:20:58.332110 14114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:58.332173 14114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:58.332267 14114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:58.333036 14114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40285 } }
I20260812 11:20:58.333335 14114 leader_election.cc:302] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5214562cdda0462ab1f94a8c9cb00c7a; no voters:
I20260812 11:20:58.333601 14114 leader_election.cc:288] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:20:58.333751 14123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:58.333978 14123 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [term 1 LEADER]: Becoming Leader. State: Replica: 5214562cdda0462ab1f94a8c9cb00c7a, State: Running, Role: LEADER
I20260812 11:20:58.334280 14123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40285 } }
I20260812 11:20:58.334649 14114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:58.335862 14127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5214562cdda0462ab1f94a8c9cb00c7a. Latest consensus state: current_term: 1 leader_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40285 } } }
I20260812 11:20:58.335992 14127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:58.335855 14126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5214562cdda0462ab1f94a8c9cb00c7a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40285 } } }
I20260812 11:20:58.336225 14126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a [sys.catalog]: This master's current role is: LEADER
W20260812 11:20:58.339286 14154 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:20:58.339363 14154 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:20:58.339421 14141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:58.340075 14141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:58.344767 14141 catalog_manager.cc:1347] Generated new cluster ID: 5299378b1557497f9b6e01f5493ad871
I20260812 11:20:58.344834 14141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:58.356608 14141 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:58.357409 14141 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:58.367905 14141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5214562cdda0462ab1f94a8c9cb00c7a: Generated new TSK 0
I20260812 11:20:58.368572 14141 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:20:58.400411 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40285
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:58.507078 14169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:58.507311 14169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:58.507370 14169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:58.511472 14169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:58.511519 14169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:58.511600 14169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:20:58.516480 14169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40285
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:58.517331 14169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:58.518208 14169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:58.526885 14185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:58.526892 14181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:58.526911 14180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:58.527168 14169 server_base.cc:1034] running on GCE node
I20260812 11:20:58.527606 14169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:58.528160 14169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:58.529315 14169 hybrid_clock.cc:648] HybridClock initialized: now 1786533658529303 us; error 23 us; skew 500 ppm
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:58.531833 14169 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:20:58.532640 14169 webserver.cc:460] Webserver started at http://127.12.175.193:45741/ using document root <none> and password file <none>
I20260812 11:20:58.533145 14169 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:58.533212 14169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:58.533411 14169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:58.535374 14169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "800883db318e4f6583c972524e08bab6"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "c30097bafab82a32dec82abf488c5f26"
server_key_iv: "96a71b9d93d2eaacee91e6e61a8f6cd2"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.535908 14169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "800883db318e4f6583c972524e08bab6"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "c30097bafab82a32dec82abf488c5f26"
server_key_iv: "96a71b9d93d2eaacee91e6e61a8f6cd2"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.539242 14169 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:58.541445 14199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.542546 14169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:20:58.542658 14169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "800883db318e4f6583c972524e08bab6"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "c30097bafab82a32dec82abf488c5f26"
server_key_iv: "96a71b9d93d2eaacee91e6e61a8f6cd2"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.542743 14169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:58.555218 14169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:58.557570 14169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:58.557719 14169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:58.558212 14169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:58.558967 14169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:58.559037 14169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.559083 14169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:58.559111 14169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.567149 14169 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:42465
I20260812 11:20:58.567179 14404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:42465 every 8 connection(s)
I20260812 11:20:58.567909 14169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:58.575671 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14169
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:58.575770 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:20:58.576032 12991 external_mini_cluster.cc:1428] Setting key e92abd90d0920018f4e2009562a6750c
I20260812 11:20:58.579726 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.569523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:32973 (local address 127.12.175.254:40285)
0812 11:20:58.569653 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:58.569658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:58.570421 (+ 763us) server_negotiation.cc:407] Connection header received
0812 11:20:58.571172 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:58.571175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:58.571221 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:58.571345 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:58.572326 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.572838 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.573862 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.574086 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.574156 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.576343 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:58.576346 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:58.576348 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:58.576372 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:58.577739 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.578248 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.578250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.578252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.578316 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.578641 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.578643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.578645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.578819 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:58.578893 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:58.579476 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 11:20:58.579610 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:20:58.580777 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.569872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40285 (local address 127.12.175.193:32973)
0812 11:20:58.570284 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:58.570322 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:58.570988 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:58.571474 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:58.571480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:58.571780 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:58.572213 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:58.572226 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.572923 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.572925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:58.573775 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:58.573784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.574186 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.574188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:58.574314 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.574775 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:58.574790 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:58.576189 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:58.577852 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:58.577857 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:58.577871 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:58.578166 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:58.578385 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:58.578387 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:58.578389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:58.578556 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:58.578907 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:58.578912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:58.579177 (+ 265us) client_negotiation.cc:769] Sending connection context
0812 11:20:58.579859 (+ 682us) client_negotiation.cc:240] Negotiation successful
0812 11:20:58.580102 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260812 11:20:58.581848 14406 heartbeater.cc:347] Connected to a master server at 127.12.175.254:40285
I20260812 11:20:58.582073 14406 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:58.582513 14406 heartbeater.cc:511] Master 127.12.175.254:40285 requested a full tablet report, sending...
I20260812 11:20:58.583923 14048 ts_manager.cc:194] Registered new tserver with Master: 800883db318e4f6583c972524e08bab6 (127.12.175.193:42465)
I20260812 11:20:58.584981 14048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:32973
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:20:58.601186 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40285
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:58.705643 14414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:58.705844 14414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:58.705884 14414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:58.709790 14414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:58.709836 14414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:58.709890 14414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:20:58.715615 14414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40285
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:58.716399 14414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:58.717247 14414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:58.725822 14422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:58.725878 14414 server_base.cc:1034] running on GCE node
W20260812 11:20:58.725889 14430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:58.725802 14424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:58.726467 14414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:58.727049 14414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:58.728214 14414 hybrid_clock.cc:648] HybridClock initialized: now 1786533658728191 us; error 39 us; skew 500 ppm
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:58.730688 14414 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:20:58.731527 14414 webserver.cc:460] Webserver started at http://127.12.175.194:36153/ using document root <none> and password file <none>
I20260812 11:20:58.732012 14414 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:58.732069 14414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:58.732221 14414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:58.734073 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "6fdde0344703412ebc167ff25f3d5470"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "99984599d0d131f1e51131e0b16eab4d"
server_key_iv: "c0b3c2d4671e2a3d9aa200faa2ec1c6a"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.734571 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "6fdde0344703412ebc167ff25f3d5470"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "99984599d0d131f1e51131e0b16eab4d"
server_key_iv: "c0b3c2d4671e2a3d9aa200faa2ec1c6a"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.738142 14414 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:20:58.740478 14438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.741598 14414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:20:58.741727 14414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "6fdde0344703412ebc167ff25f3d5470"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "99984599d0d131f1e51131e0b16eab4d"
server_key_iv: "c0b3c2d4671e2a3d9aa200faa2ec1c6a"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.741822 14414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:58.751483 14414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:58.753978 14414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:58.754141 14414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:58.754663 14414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:58.755445 14414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:58.755492 14414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.755535 14414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:58.755564 14414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.763785 14414 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:39761
I20260812 11:20:58.763816 14657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:39761 every 8 connection(s)
I20260812 11:20:58.764573 14414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:58.766233 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14414
I20260812 11:20:58.766351 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:20:58.766597 12991 external_mini_cluster.cc:1428] Setting key b3b26fb3fafb1bdbcf3b1bca9b448167
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:20:58.777459 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.766215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:52249 (local address 127.12.175.254:40285)
0812 11:20:58.766357 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:58.766362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:58.767185 (+ 823us) server_negotiation.cc:407] Connection header received
0812 11:20:58.768050 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:58.768054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:58.768104 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:58.768180 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:58.769252 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.769951 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.771539 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.771830 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.771930 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.774125 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:58.774129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:58.774132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:58.774160 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:58.775616 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.776085 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.776088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.776090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.776180 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.776462 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.776465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.776467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.776684 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:58.776787 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:58.777235 (+ 448us) server_negotiation.cc:299] Negotiation successful
0812 11:20:58.777343 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:20:58.778143 14664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.766584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40285 (local address 127.12.175.194:52249)
0812 11:20:58.767052 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:58.767092 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:58.767861 (+ 769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:58.768336 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:58.768342 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:58.768664 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:58.769110 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:58.769123 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.770081 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.770085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:58.771435 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:58.771446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.771955 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.771957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:58.772110 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.772598 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:58.772614 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:58.773950 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:58.775724 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:58.775729 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:58.775740 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:58.775977 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:58.776260 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:58.776262 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:58.776263 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:58.776377 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:58.776771 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:58.776775 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:58.776980 (+ 205us) client_negotiation.cc:769] Sending connection context
0812 11:20:58.777159 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 11:20:58.777391 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":122,"threads_started":1}
I20260812 11:20:58.779215 14658 heartbeater.cc:347] Connected to a master server at 127.12.175.254:40285
I20260812 11:20:58.779452 14658 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
I20260812 11:20:58.779963 14658 heartbeater.cc:511] Master 127.12.175.254:40285 requested a full tablet report, sending...
I20260812 11:20:58.781044 14048 ts_manager.cc:194] Registered new tserver with Master: 6fdde0344703412ebc167ff25f3d5470 (127.12.175.194:39761)
I20260812 11:20:58.781589 14048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:52249
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:20:58.794126 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40285
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:58.899788 14668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:58.899998 14668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:58.900039 14668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:58.903942 14668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:58.903987 14668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:58.904055 14668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:20:58.908965 14668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40285
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:20:58.909868 14668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:58.910766 14668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:58.919564 14687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:58.919561 14680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:58.919596 14681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:58.919605 14668 server_base.cc:1034] running on GCE node
I20260812 11:20:58.920147 14668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:58.920693 14668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:58.921847 14668 hybrid_clock.cc:648] HybridClock initialized: now 1786533658921829 us; error 30 us; skew 500 ppm
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:58.924564 14668 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:20:58.925300 14668 webserver.cc:460] Webserver started at http://127.12.175.195:40927/ using document root <none> and password file <none>
I20260812 11:20:58.925781 14668 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:58.925843 14668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:58.926028 14668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:58.927954 14668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "abaecc2d1fcb49f79f5bdfd667f143ca"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "ec0a01509ef8e57c1ef538f4632ba75e"
server_key_iv: "ea052d03e171d8a4c63a3f459eb9f2e9"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.928472 14668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "abaecc2d1fcb49f79f5bdfd667f143ca"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "ec0a01509ef8e57c1ef538f4632ba75e"
server_key_iv: "ea052d03e171d8a4c63a3f459eb9f2e9"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.931830 14668 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:58.934005 14701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.935161 14668 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:20:58.935297 14668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "abaecc2d1fcb49f79f5bdfd667f143ca"
format_stamp: "Formatted at 2026-08-12 11:20:58 on dist-test-slave-gjrz"
server_key: "ec0a01509ef8e57c1ef538f4632ba75e"
server_key_iv: "ea052d03e171d8a4c63a3f459eb9f2e9"
server_key_version: "encryptionkey@0"
I20260812 11:20:58.935395 14668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:58.954435 14668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:58.956929 14668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:58.957091 14668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:58.957581 14668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:58.958308 14668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:58.958353 14668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.958402 14668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:58.958431 14668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:58.966676 14668 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:40209
I20260812 11:20:58.966692 14913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:40209 every 8 connection(s)
I20260812 11:20:58.967491 14668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:58.969403 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14668
I20260812 11:20:58.969501 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:20:58.969735 12991 external_mini_cluster.cc:1428] Setting key c6202b7ab4d2cf5634df12de49018d74
Aug 12 11:20:58 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:20:58.979374 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.969129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:39301 (local address 127.12.175.254:40285)
0812 11:20:58.969282 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:58.969287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:58.970104 (+ 817us) server_negotiation.cc:407] Connection header received
0812 11:20:58.971098 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:58.971102 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:58.971151 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:58.971227 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:58.972302 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.972837 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.973860 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.974072 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.974146 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.976246 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:58.976250 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:58.976252 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:58.976275 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:58.977512 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.977971 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.977974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.977976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.978050 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.978349 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.978352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.978354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.978523 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:58.978607 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:58.979082 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 11:20:58.979198 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:20:58.980041 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.969447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40285 (local address 127.12.175.195:39301)
0812 11:20:58.969943 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:58.969999 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:58.970921 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:58.971394 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:58.971400 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:58.971728 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:58.972176 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:58.972190 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.972929 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.972931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:58.973773 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:58.973782 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.974174 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.974176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:58.974304 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.974736 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:58.974751 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:58.976096 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:58.977616 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:58.977622 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:58.977635 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:58.977872 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:58.978131 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:58.978134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:58.978136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:58.978263 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:58.978620 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:58.978626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:58.978866 (+ 240us) client_negotiation.cc:769] Sending connection context
0812 11:20:58.979025 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:20:58.979327 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":118,"threads_started":1}
I20260812 11:20:58.980988 14917 heartbeater.cc:347] Connected to a master server at 127.12.175.254:40285
I20260812 11:20:58.981168 14917 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:58.981559 14917 heartbeater.cc:511] Master 127.12.175.254:40285 requested a full tablet report, sending...
I20260812 11:20:58.982493 14047 ts_manager.cc:194] Registered new tserver with Master: abaecc2d1fcb49f79f5bdfd667f143ca (127.12.175.195:40209)
I20260812 11:20:58.983043 14047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:39301
I20260812 11:20:58.983177 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:20:58.992249 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:58.986246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56770 (local address 127.12.175.254:40285)
0812 11:20:58.986362 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:58.986366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:58.986507 (+ 141us) server_negotiation.cc:407] Connection header received
0812 11:20:58.986627 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:58.986631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:58.986670 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:58.986734 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:58.987383 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.987858 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.988632 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:58.988843 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:58.988926 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:58.989997 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:58.990001 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:58.990003 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:58.990026 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:58.990967 (+ 941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.991353 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.991356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.991357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.991432 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:58.991637 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:58.991639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:58.991640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:58.991811 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:58.991904 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:58.992043 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 11:20:58.992122 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:20:58.996388 14047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:20:58.999099 14047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:20:59.012555 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.007481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59842 (local address 127.12.175.193:42465)
0812 11:20:59.007892 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.007904 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.007927 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:20:59.008250 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.008256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.008441 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.008594 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:59.008908 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.009928 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.011374 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.011903 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.012020 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.012145 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.012314 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.012410 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":107,"threads_started":1}
I20260812 11:20:59.012545 14953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.006647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40209 (local address 127.0.0.1:33814)
0812 11:20:59.007142 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:59.007184 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:59.007322 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:59.008303 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:59.008309 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:59.008331 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:59.008463 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.008470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.009797 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.009801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.011192 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.011199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.011992 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.011995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.012112 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.012158 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 11:20:59.012269 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:20:59.012411 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":124,"thread_start_us":73,"threads_started":1}
I20260812 11:20:59.012549 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.006758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42465 (local address 127.0.0.1:59842)
0812 11:20:59.007418 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:59.007431 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:59.008094 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:59.008692 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:59.008695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:59.008712 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:59.008801 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.008808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.010057 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.010061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.011203 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.011213 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.012034 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.012045 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.012146 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.012170 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:20:59.012273 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:20:59.012404 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":8,"thread_start_us":92,"threads_started":1}
I20260812 11:20:59.012945 14956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.006733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33814 (local address 127.12.175.195:40209)
0812 11:20:59.007869 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.007880 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.007901 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:20:59.007967 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.007972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.008159 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.008305 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:59.008594 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.009668 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.011319 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.011866 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.011963 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.012082 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.012722 (+ 640us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.012816 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045,"thread_start_us":84,"threads_started":1}
I20260812 11:20:59.013778 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.007060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:39761 (local address 127.0.0.1:35804)
0812 11:20:59.007564 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:59.007578 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:59.007656 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:59.008515 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:59.008518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:59.008535 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:59.008641 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.008647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.009637 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.009640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.011188 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.011199 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.013336 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.013339 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.013440 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.013474 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:20:59.013537 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:20:59.013602 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":141,"thread_start_us":79,"threads_started":1}
I20260812 11:20:59.014184 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.007450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35804 (local address 127.12.175.194:39761)
0812 11:20:59.008099 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.008109 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.008130 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:20:59.008200 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.008205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.008372 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.008515 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:59.008775 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.009515 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.012145 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.013213 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.013677 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.013908 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.013960 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.014043 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":120,"threads_started":1}
I20260812 11:20:59.015637 14287 tablet_service.cc:1467] Processing CreateTablet for tablet 1698130346344d96b7d67a701395838d (DEFAULT_TABLE table=test-table [id=28e137d1c53146afb4ca878455336f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:59.015647 14792 tablet_service.cc:1467] Processing CreateTablet for tablet 1698130346344d96b7d67a701395838d (DEFAULT_TABLE table=test-table [id=28e137d1c53146afb4ca878455336f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:59.016542 14287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1698130346344d96b7d67a701395838d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:59.016680 14792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1698130346344d96b7d67a701395838d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:59.016940 14527 tablet_service.cc:1467] Processing CreateTablet for tablet 1698130346344d96b7d67a701395838d (DEFAULT_TABLE table=test-table [id=28e137d1c53146afb4ca878455336f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:59.017840 14527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1698130346344d96b7d67a701395838d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:59.022192 14970 tablet_bootstrap.cc:492] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: Bootstrap starting.
I20260812 11:20:59.023423 14971 tablet_bootstrap.cc:492] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: Bootstrap starting.
I20260812 11:20:59.024259 14972 tablet_bootstrap.cc:492] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: Bootstrap starting.
I20260812 11:20:59.025317 14971 tablet_bootstrap.cc:654] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:59.025671 14970 tablet_bootstrap.cc:654] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:59.026228 14972 tablet_bootstrap.cc:654] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:59.026499 14971 log.cc:824] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:59.026499 14970 log.cc:824] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:59.026901 14972 log.cc:824] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:59.028421 14970 tablet_bootstrap.cc:492] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: No bootstrap required, opened a new log
I20260812 11:20:59.028421 14971 tablet_bootstrap.cc:492] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: No bootstrap required, opened a new log
I20260812 11:20:59.028609 14971 ts_tablet_manager.cc:1397] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:20:59.028609 14970 ts_tablet_manager.cc:1397] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 11:20:59.032490 14972 tablet_bootstrap.cc:492] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: No bootstrap required, opened a new log
I20260812 11:20:59.032322 14971 raft_consensus.cc:348] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.032322 14970 raft_consensus.cc:348] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.032581 14970 raft_consensus.cc:374] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:59.032581 14971 raft_consensus.cc:374] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:59.032640 14971 raft_consensus.cc:729] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abaecc2d1fcb49f79f5bdfd667f143ca, State: Initialized, Role: FOLLOWER
I20260812 11:20:59.032646 14970 raft_consensus.cc:729] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800883db318e4f6583c972524e08bab6, State: Initialized, Role: FOLLOWER
I20260812 11:20:59.032661 14972 ts_tablet_manager.cc:1397] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260812 11:20:59.033073 14970 consensus_queue.cc:260] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.033073 14971 consensus_queue.cc:260] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.033699 14917 heartbeater.cc:503] Master 127.12.175.254:40285 was elected leader, sending a full tablet report...
I20260812 11:20:59.033972 14406 heartbeater.cc:503] Master 127.12.175.254:40285 was elected leader, sending a full tablet report...
I20260812 11:20:59.034011 14970 ts_tablet_manager.cc:1428] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:20:59.034531 14971 ts_tablet_manager.cc:1428] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 11:20:59.036396 14972 raft_consensus.cc:348] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.036648 14972 raft_consensus.cc:374] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:59.036707 14972 raft_consensus.cc:729] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdde0344703412ebc167ff25f3d5470, State: Initialized, Role: FOLLOWER
I20260812 11:20:59.037158 14972 consensus_queue.cc:260] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.038038 14972 ts_tablet_manager.cc:1428] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260812 11:20:59.038064 14658 heartbeater.cc:503] Master 127.12.175.254:40285 was elected leader, sending a full tablet report...
W20260812 11:20:59.068912 14407 tablet.cc:2369] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:20:59.218353 14924 tablet.cc:2369] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:20:59.265762 14663 tablet.cc:2369] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:59.395694 14978 raft_consensus.cc:482] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:20:59.395884 14978 raft_consensus.cc:504] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.397009 14978 leader_election.cc:288] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800883db318e4f6583c972524e08bab6 (127.12.175.193:42465), 6fdde0344703412ebc167ff25f3d5470 (127.12.175.194:39761)
I20260812 11:20:59.400691 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.397240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42465 (local address 127.12.175.195:34403)
0812 11:20:59.397428 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:59.397443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:59.397531 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:59.397829 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:59.397832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:59.397850 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:59.397976 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.397983 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.398772 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.398775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.399641 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.399650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.400296 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.400300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.400402 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.400428 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:20:59.400498 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:20:59.400560 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":22}
I20260812 11:20:59.400729 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.397465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:34403 (local address 127.12.175.193:42465)
0812 11:20:59.397602 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.397606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.397623 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:20:59.397680 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.397683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.397739 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.397815 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:59.398086 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.398663 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.399760 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.400192 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.400284 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.400326 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.400527 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.400603 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:20:59.400823 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.397364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:34037 (local address 127.12.175.194:39761)
0812 11:20:59.397501 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.397506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.397802 (+ 296us) server_negotiation.cc:407] Connection header received
0812 11:20:59.397911 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.397914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.397966 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.398050 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:59.398301 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.398808 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.399900 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.400309 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.400417 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.400462 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.400646 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.400718 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:20:59.401176 14983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.397274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:39761 (local address 127.12.175.195:34037)
0812 11:20:59.397697 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:59.397710 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:59.397815 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:59.398067 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:59.398069 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:59.398086 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:59.398204 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.398209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.398912 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.398914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.399776 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:59.399787 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.400419 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.400421 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:59.400513 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.400545 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:20:59.400616 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:20:59.400680 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":16,"thread_start_us":109,"threads_started":1}
I20260812 11:20:59.401319 14320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1698130346344d96b7d67a701395838d" candidate_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800883db318e4f6583c972524e08bab6" is_pre_election: true
I20260812 11:20:59.401633 14320 raft_consensus.cc:2454] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abaecc2d1fcb49f79f5bdfd667f143ca in term 0.
I20260812 11:20:59.401739 14565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1698130346344d96b7d67a701395838d" candidate_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdde0344703412ebc167ff25f3d5470" is_pre_election: true
I20260812 11:20:59.402014 14565 raft_consensus.cc:2454] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abaecc2d1fcb49f79f5bdfd667f143ca in term 0.
I20260812 11:20:59.402125 14703 leader_election.cc:302] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800883db318e4f6583c972524e08bab6, abaecc2d1fcb49f79f5bdfd667f143ca; no voters:
I20260812 11:20:59.402385 14978 raft_consensus.cc:2781] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:20:59.402465 14978 raft_consensus.cc:482] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:20:59.402498 14978 raft_consensus.cc:3037] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:59.403518 14978 raft_consensus.cc:504] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.403855 14978 leader_election.cc:288] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [CANDIDATE]: Term 1 election: Requested vote from peers 800883db318e4f6583c972524e08bab6 (127.12.175.193:42465), 6fdde0344703412ebc167ff25f3d5470 (127.12.175.194:39761)
I20260812 11:20:59.404220 14565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1698130346344d96b7d67a701395838d" candidate_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdde0344703412ebc167ff25f3d5470"
I20260812 11:20:59.404222 14320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1698130346344d96b7d67a701395838d" candidate_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800883db318e4f6583c972524e08bab6"
I20260812 11:20:59.404340 14565 raft_consensus.cc:3037] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:59.404340 14320 raft_consensus.cc:3037] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:59.405558 14565 raft_consensus.cc:2454] T 1698130346344d96b7d67a701395838d P 6fdde0344703412ebc167ff25f3d5470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abaecc2d1fcb49f79f5bdfd667f143ca in term 1.
I20260812 11:20:59.405561 14320 raft_consensus.cc:2454] T 1698130346344d96b7d67a701395838d P 800883db318e4f6583c972524e08bab6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abaecc2d1fcb49f79f5bdfd667f143ca in term 1.
I20260812 11:20:59.405830 14703 leader_election.cc:302] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800883db318e4f6583c972524e08bab6, abaecc2d1fcb49f79f5bdfd667f143ca; no voters:
I20260812 11:20:59.405982 14978 raft_consensus.cc:2781] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:59.406196 14978 raft_consensus.cc:686] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [term 1 LEADER]: Becoming Leader. State: Replica: abaecc2d1fcb49f79f5bdfd667f143ca, State: Running, Role: LEADER
I20260812 11:20:59.406657 14978 consensus_queue.cc:237] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } }
I20260812 11:20:59.409699 14047 catalog_manager.cc:5495] T 1698130346344d96b7d67a701395838d P abaecc2d1fcb49f79f5bdfd667f143ca reported cstate change: term changed from 0 to 1, leader changed from <none> to abaecc2d1fcb49f79f5bdfd667f143ca (127.12.175.195). New cstate: current_term: 1 leader_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abaecc2d1fcb49f79f5bdfd667f143ca" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "800883db318e4f6583c972524e08bab6" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdde0344703412ebc167ff25f3d5470" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39761 } health_report { overall_health: UNKNOWN } } }
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:20:59.460323 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.452519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59846 (local address 127.12.175.193:42465)
0812 11:20:59.452634 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.452639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.452844 (+ 205us) server_negotiation.cc:407] Connection header received
0812 11:20:59.452958 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.452962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.453004 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.453067 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:59.453742 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.454219 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.455031 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.455240 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.455344 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.457576 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:59.457587 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:59.457599 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:59.457621 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:59.458945 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:59.459343 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:59.459348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:59.459350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:59.459431 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:59.459628 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:59.459630 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:59.459631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:59.459848 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:59.459994 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.460123 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.460214 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533659, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533659, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:20:59.485232 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.478313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59862 (local address 127.12.175.193:42465)
0812 11:20:59.478422 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.478426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.478562 (+ 136us) server_negotiation.cc:407] Connection header received
0812 11:20:59.478649 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.478651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.478686 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.478745 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:59.479322 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.479811 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.480553 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.480765 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.480832 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.482768 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:59.482771 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:59.482773 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:59.482794 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:59.483954 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:59.484289 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:59.484292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:59.484293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:59.484354 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:59.484583 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:59.484586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:59.484587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:59.484733 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:59.484824 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.485010 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.485096 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[13968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[13968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:20:59.509444 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:59.502454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59876 (local address 127.12.175.193:42465)
0812 11:20:59.502573 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:59.502577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:59.502688 (+ 111us) server_negotiation.cc:407] Connection header received
0812 11:20:59.502805 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:59.502808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:59.502848 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:59.502907 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:59.503506 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.503973 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.504730 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:59.504939 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:59.505022 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:59.506956 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:59.506959 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:59.506961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:59.506982 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:59.508059 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:59.508418 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:59.508422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:59.508423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:59.508491 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:59.508728 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:59.508731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:59.508732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:59.508880 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:59.508988 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:59.509211 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 11:20:59.509309 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 11:20:59.510663 14247 tablet_service.cc:2908] Rejecting scan request for tablet 1698130346344d96b7d67a701395838d: Uninitialized: clean time has not yet been initialized
I20260812 11:20:59.512261 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14169
I20260812 11:20:59.525563 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14414
I20260812 11:20:59.538241 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14668
I20260812 11:20:59.545910 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13985
2026-08-12T11:20:59Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2692 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[15006](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[15006](info): set up 2 sockets
Aug 12 11:20:59 dist-test-slave-gjrz krb5kdc[15006](info): commencing operation
krb5kdc: starting...
W20260812 11:21:00.735790 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:00 dist-test-slave-gjrz krb5kdc[15006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:00.848268 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:41837
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:41837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:00.952509 15036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:00.952716 15036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:00.952752 15036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:00.956561 15036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:00.956600 15036 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:21:00.956617 15036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:00.956633 15036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:00.956660 15036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:00.956688 15036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:00.961584 15036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:41837
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:41837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:00.962460 15036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:00.963361 15036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:00.971078 15049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:00.971101 15036 server_base.cc:1034] running on GCE node
W20260812 11:21:00.971058 15051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:00.971364 15055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:00.971835 15036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:00.972817 15036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:00.973971 15036 hybrid_clock.cc:648] HybridClock initialized: now 1786533660973958 us; error 26 us; skew 500 ppm
Aug 12 11:21:00 dist-test-slave-gjrz krb5kdc[15006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533660, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:00.979713 15036 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:00.980486 15036 webserver.cc:460] Webserver started at http://127.12.175.254:43975/ using document root <none> and password file <none>
I20260812 11:21:00.980968 15036 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:00.981032 15036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:00.981220 15036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:00.983062 15036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "633f5bd009ad4a0d973ab4852f22c6ea"
format_stamp: "Formatted at 2026-08-12 11:21:00 on dist-test-slave-gjrz"
server_key: "c25ab26edba734fcdfd75eeeb43ffe6f"
server_key_iv: "a1965edc89f54d9df4ab2555827f2e9a"
server_key_version: "encryptionkey@0"
I20260812 11:21:00.983610 15036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "633f5bd009ad4a0d973ab4852f22c6ea"
format_stamp: "Formatted at 2026-08-12 11:21:00 on dist-test-slave-gjrz"
server_key: "c25ab26edba734fcdfd75eeeb43ffe6f"
server_key_iv: "a1965edc89f54d9df4ab2555827f2e9a"
server_key_version: "encryptionkey@0"
I20260812 11:21:00.986879 15036 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:00.989014 15066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:00.990113 15036 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:00.990231 15036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "633f5bd009ad4a0d973ab4852f22c6ea"
format_stamp: "Formatted at 2026-08-12 11:21:00 on dist-test-slave-gjrz"
server_key: "c25ab26edba734fcdfd75eeeb43ffe6f"
server_key_iv: "a1965edc89f54d9df4ab2555827f2e9a"
server_key_version: "encryptionkey@0"
I20260812 11:21:00.990317 15036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:00.999945 15036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:01.002254 15036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:01.002408 15036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:01.009555 15036 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:41837
I20260812 11:21:01.009572 15176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:41837 every 8 connection(s)
I20260812 11:21:01.010350 15036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:01.012933 15177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:01.013125 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15036
I20260812 11:21:01.013235 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:01.013504 12991 external_mini_cluster.cc:1428] Setting key e8709844f18d1ed6f5fd74c49e15d445
I20260812 11:21:01.019209 15177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: Bootstrap starting.
I20260812 11:21:01.021755 15177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: Neither blocks nor log segments found. Creating new log.
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:01.022482 15177 log.cc:824] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:01.024642 15177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: No bootstrap required, opened a new log
I20260812 11:21:01.028206 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.014742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36492 (local address 127.12.175.254:41837)
0812 11:21:01.015124 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.015139 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.015173 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:21:01.015919 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.015957 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.016263 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.016519 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.017395 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.018376 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.019547 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.020042 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.020166 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.022800 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.022805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.022817 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.022844 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.025302 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.025706 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.025713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.025718 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.025851 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.026094 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.026097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.026098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.026593 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.026778 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.026961 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.027252 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":104,"threads_started":1}
I20260812 11:21:01.028352 15177 raft_consensus.cc:348] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 41837 } }
I20260812 11:21:01.028628 15177 raft_consensus.cc:374] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:01.028695 15177 raft_consensus.cc:729] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 633f5bd009ad4a0d973ab4852f22c6ea, State: Initialized, Role: FOLLOWER
I20260812 11:21:01.029136 15177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 41837 } }
I20260812 11:21:01.029290 15177 raft_consensus.cc:388] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:01.029393 15177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:01.029486 15177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:01.030354 15177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 41837 } }
I20260812 11:21:01.030682 15177 leader_election.cc:302] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 633f5bd009ad4a0d973ab4852f22c6ea; no voters:
I20260812 11:21:01.030963 15177 leader_election.cc:288] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:01.031066 15187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:01.031304 15187 raft_consensus.cc:686] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [term 1 LEADER]: Becoming Leader. State: Replica: 633f5bd009ad4a0d973ab4852f22c6ea, State: Running, Role: LEADER
I20260812 11:21:01.031607 15187 consensus_queue.cc:237] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 41837 } }
I20260812 11:21:01.032047 15177 sys_catalog.cc:564] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:01.033249 15188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 41837 } } }
I20260812 11:21:01.033281 15195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 633f5bd009ad4a0d973ab4852f22c6ea. Latest consensus state: current_term: 1 leader_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633f5bd009ad4a0d973ab4852f22c6ea" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 41837 } } }
I20260812 11:21:01.033375 15188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:01.033375 15195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:01.036465 15216 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:01.036528 15216 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:01.036602 15209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:01.037276 15209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:01.041891 15209 catalog_manager.cc:1347] Generated new cluster ID: 3c514b0bd6244280ab9491068c7792ce
I20260812 11:21:01.041949 15209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:01.059913 15209 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:01.061062 15209 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:01.066051 15209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: Generated new TSK 0
I20260812 11:21:01.066713 15209 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:01.093624 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:41837
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:01.200193 15229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:01.200416 15229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:01.200474 15229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:01.204370 15229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:01.204422 15229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:01.204474 15229 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:01.204532 15229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:01.209496 15229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:41837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:01.210377 15229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:01.211294 15229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:01.219992 15241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:01.220026 15244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:01.220017 15242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:01.220247 15229 server_base.cc:1034] running on GCE node
I20260812 11:21:01.220613 15229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:01.221189 15229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:01.222348 15229 hybrid_clock.cc:648] HybridClock initialized: now 1786533661222332 us; error 26 us; skew 500 ppm
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:01.224884 15229 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:01.225690 15229 webserver.cc:460] Webserver started at http://127.12.175.193:45233/ using document root <none> and password file <none>
I20260812 11:21:01.226198 15229 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:01.226262 15229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:01.226444 15229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:01.228382 15229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "7746ebbae3174dcfaaf96abe6ee851a5"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "7c037b663c1be52021f5592f778d5b96"
server_key_iv: "d8c90a37ba5bfbdb311c172de41b61c5"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.228921 15229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "7746ebbae3174dcfaaf96abe6ee851a5"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "7c037b663c1be52021f5592f778d5b96"
server_key_iv: "d8c90a37ba5bfbdb311c172de41b61c5"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.232333 15229 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260812 11:21:01.234611 15258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:01.235699 15229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:01.235802 15229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "7746ebbae3174dcfaaf96abe6ee851a5"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "7c037b663c1be52021f5592f778d5b96"
server_key_iv: "d8c90a37ba5bfbdb311c172de41b61c5"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.235888 15229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:01.266639 15229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:01.269490 15229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:01.269654 15229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:01.270973 15229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:01.271028 15229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:01.271080 15229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:01.271106 15229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:01.281059 15229 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:39909
I20260812 11:21:01.281131 15456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:39909 every 8 connection(s)
I20260812 11:21:01.282064 15229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:01.284045 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.271716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:43603 (local address 127.12.175.254:41837)
0812 11:21:01.271829 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.271834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.272815 (+ 981us) server_negotiation.cc:407] Connection header received
0812 11:21:01.273670 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.273674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.273741 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.273809 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.274936 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.275505 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.276646 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.276962 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.277061 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.280483 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.280486 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.280488 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.280512 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.282055 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.282613 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.282617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.282619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.282714 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.283136 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.283139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.283140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.283355 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.283435 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.283827 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.283924 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:21:01.284701 15271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.272229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.12.175.193:43603)
0812 11:21:01.272674 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.272713 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.273472 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.273993 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.274002 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.274366 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:01.274791 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.274804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.275624 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.275627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.276531 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.276542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.277104 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.277108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.277287 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.277804 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:01.277826 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:01.280321 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:01.282182 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.282188 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.282202 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.282484 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.282925 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.282928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.282929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.283060 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.283435 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:01.283440 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:01.283642 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.283792 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.284027 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":129,"threads_started":1}
I20260812 11:21:01.285740 15457 heartbeater.cc:347] Connected to a master server at 127.12.175.254:41837
I20260812 11:21:01.285868 15457 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:01.286293 15457 heartbeater.cc:511] Master 127.12.175.254:41837 requested a full tablet report, sending...
I20260812 11:21:01.287834 15096 ts_manager.cc:194] Registered new tserver with Master: 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909)
I20260812 11:21:01.289182 15096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:43603
I20260812 11:21:01.289319 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15229
I20260812 11:21:01.289426 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:01.289712 12991 external_mini_cluster.cc:1428] Setting key 5629514c1631cf0a0bdf73055da771bc
I20260812 11:21:01.295190 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.288721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:41175 (local address 127.12.175.254:41837)
0812 11:21:01.288834 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.288837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.288847 (+ 10us) server_negotiation.cc:407] Connection header received
0812 11:21:01.288874 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.288876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.288906 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.288972 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.289407 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.289987 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.291149 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.291486 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.291595 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.292505 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.292516 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.292518 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.292541 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.293782 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.294239 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.294241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.294242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.294311 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.294563 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.294565 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.294566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.294706 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.294773 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.295005 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.295093 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:21:01.295300 15469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.287552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.12.175.193:41175)
0812 11:21:01.287896 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.287910 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.287989 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.289003 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.289006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.289192 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:01.289284 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.289291 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.290142 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.290145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.291008 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.291018 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.291614 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.291617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.291704 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.292093 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:01.292104 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:01.292382 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:01.293889 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.293892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.293894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.294156 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.294390 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.294393 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.294395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.294482 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.294783 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:01.294785 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:01.294873 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.294974 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.295094 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":1,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:01.315303 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:41837
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:01.419176 15477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:01.419411 15477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:01.419463 15477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:01.423303 15477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:01.423353 15477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:01.423403 15477 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:01.423453 15477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:01.428357 15477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:41837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:01.429189 15477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:01.430065 15477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:01.438953 15489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:01.438997 15477 server_base.cc:1034] running on GCE node
W20260812 11:21:01.438959 15486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:01.438962 15485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:01.439631 15477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:01.440204 15477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:01.441367 15477 hybrid_clock.cc:648] HybridClock initialized: now 1786533661441359 us; error 41 us; skew 500 ppm
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:01.443913 15477 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:01.444689 15477 webserver.cc:460] Webserver started at http://127.12.175.194:41295/ using document root <none> and password file <none>
I20260812 11:21:01.445192 15477 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:01.445256 15477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:01.445449 15477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:01.447471 15477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "7284dd8372294487bef5d5e5b7049533"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "8dbd697bd1a3f4edcc710dcd87d0cf4a"
server_key_iv: "3e3d74133fb05572ec73fe4c2e990be1"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.448026 15477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "7284dd8372294487bef5d5e5b7049533"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "8dbd697bd1a3f4edcc710dcd87d0cf4a"
server_key_iv: "3e3d74133fb05572ec73fe4c2e990be1"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.451433 15477 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:01.453630 15502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:01.454749 15477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:01.454846 15477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "7284dd8372294487bef5d5e5b7049533"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "8dbd697bd1a3f4edcc710dcd87d0cf4a"
server_key_iv: "3e3d74133fb05572ec73fe4c2e990be1"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.454963 15477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:01.476022 15477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:01.478435 15477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:01.478590 15477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:01.479952 15477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:01.480003 15477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:01.480053 15477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:01.480082 15477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:01.489759 15477 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:36473
I20260812 11:21:01.490021 15722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:36473 every 8 connection(s)
I20260812 11:21:01.490584 15477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:01.493209 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.480589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39091 (local address 127.12.175.254:41837)
0812 11:21:01.480744 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.480749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.481945 (+ 1196us) server_negotiation.cc:407] Connection header received
0812 11:21:01.482942 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.482945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.483002 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.483092 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.484647 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.485453 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.486723 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.487049 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.487142 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.489459 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.489462 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.489465 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.489496 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.490998 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.491628 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.491631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.491632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.491718 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.492118 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.492121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.492123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.492314 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.492397 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.492968 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.493092 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:21:01.494148 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.481344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.12.175.194:39091)
0812 11:21:01.481775 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.481822 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.482731 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.483329 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.483338 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.483817 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:01.484490 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.484512 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.485583 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.485586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.486608 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.486618 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.487190 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.487194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.487394 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.487894 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:01.487914 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:01.489304 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:01.491150 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.491156 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.491169 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.491527 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.491808 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.491811 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.491813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.491983 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.492410 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:01.492417 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:01.492709 (+ 292us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.492902 (+ 193us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.493219 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":108,"threads_started":1}
I20260812 11:21:01.495698 15724 heartbeater.cc:347] Connected to a master server at 127.12.175.254:41837
I20260812 11:21:01.495870 15724 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:01.496420 15724 heartbeater.cc:511] Master 127.12.175.254:41837 requested a full tablet report, sending...
I20260812 11:21:01.497999 15097 ts_manager.cc:194] Registered new tserver with Master: 7284dd8372294487bef5d5e5b7049533 (127.12.175.194:36473)
I20260812 11:21:01.498553 15097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:39091
I20260812 11:21:01.500454 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15477
I20260812 11:21:01.500552 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:01.500792 12991 external_mini_cluster.cc:1428] Setting key a7974351fb89dec7e65b27e7adfae560
I20260812 11:21:01.506042 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.497995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:59445 (local address 127.12.175.254:41837)
0812 11:21:01.499791 (+ 1796us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.499796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.499811 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:21:01.499875 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.499878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.499933 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.500006 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.500395 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.500972 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.501988 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.502265 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.502370 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.503251 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.503254 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.503257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.503302 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.504581 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.504993 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.504995 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.504996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.505058 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.505298 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.505300 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.505301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.505484 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.505558 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.505811 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.505912 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1684}
I20260812 11:21:01.506047 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.497947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.12.175.194:59445)
0812 11:21:01.498266 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.498280 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.498369 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.500025 (+ 1656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.500028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.500206 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:01.500292 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.500298 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.501113 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.501116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.501864 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.501887 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.502367 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.502369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.502436 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.502828 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:01.502839 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:01.503123 (+ 284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:01.504682 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.504686 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.504688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.504912 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.505131 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.505135 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.505137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.505228 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.505563 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:01.505565 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:01.505637 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.505728 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.505853 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:01.527522 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:41837
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:01.634034 15737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:01.634245 15737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:01.634305 15737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:01.638238 15737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:01.638290 15737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:01.638341 15737 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:01.638393 15737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:01.643448 15737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:41837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:01.644310 15737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:01.645196 15737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:01.653963 15749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:01.654023 15746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:01.653959 15752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:01.654210 15737 server_base.cc:1034] running on GCE node
I20260812 11:21:01.654706 15737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:01.655292 15737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:01.656471 15737 hybrid_clock.cc:648] HybridClock initialized: now 1786533661656445 us; error 34 us; skew 500 ppm
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:01.659013 15737 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:01.659837 15737 webserver.cc:460] Webserver started at http://127.12.175.195:34565/ using document root <none> and password file <none>
I20260812 11:21:01.660324 15737 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:01.660388 15737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:01.660574 15737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:01.662506 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "806f537e96de4d178a15fa24e1e05f98"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "d9771c66c1ef1ba98148f4140a2bb689"
server_key_iv: "650300fca2c3505ae96e1863312aa5c4"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.663012 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "806f537e96de4d178a15fa24e1e05f98"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "d9771c66c1ef1ba98148f4140a2bb689"
server_key_iv: "650300fca2c3505ae96e1863312aa5c4"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.666455 15737 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:21:01.668705 15760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:01.669760 15737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:01.669872 15737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "806f537e96de4d178a15fa24e1e05f98"
format_stamp: "Formatted at 2026-08-12 11:21:01 on dist-test-slave-gjrz"
server_key: "d9771c66c1ef1ba98148f4140a2bb689"
server_key_iv: "650300fca2c3505ae96e1863312aa5c4"
server_key_version: "encryptionkey@0"
I20260812 11:21:01.669961 15737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:01.686903 15737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:01.689302 15737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:01.689466 15737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:01.690833 15737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:01.690883 15737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:01.690932 15737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:01.690964 15737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:01.701344 15737 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:39717
I20260812 11:21:01.702024 15950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:39717 every 8 connection(s)
I20260812 11:21:01.702319 15737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:01.702911 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15737
I20260812 11:21:01.703037 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:01.703334 12991 external_mini_cluster.cc:1428] Setting key f35d364cebc53183ab62de3e20019ca3
I20260812 11:21:01.703814 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.691432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40007 (local address 127.12.175.254:41837)
0812 11:21:01.691580 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.691585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.692851 (+ 1266us) server_negotiation.cc:407] Connection header received
0812 11:21:01.693959 (+ 1108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.693963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.694020 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.694113 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.695332 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.695892 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.697206 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.697461 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.697562 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.700142 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.700146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.700149 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.700179 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.701709 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.702289 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.702292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.702293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.702370 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.702713 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.702717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.702718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.702941 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.703031 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.703541 (+ 510us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.703656 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:21:01.705549 15774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.692153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.12.175.195:40007)
0812 11:21:01.692686 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.692744 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.693722 (+ 978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.694274 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.694281 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.694592 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:01.695173 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.695191 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.696015 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.696019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.697095 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.697106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.697608 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.697612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.697775 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.698241 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:01.698259 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:01.699969 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:01.701817 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.701822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.701834 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.702182 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.702472 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.702475 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.702477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.702612 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.703037 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:01.703044 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:01.703255 (+ 211us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.703464 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.703755 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":102,"threads_started":1}
I20260812 11:21:01.706506 15953 heartbeater.cc:347] Connected to a master server at 127.12.175.254:41837
I20260812 11:21:01.706637 15953 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:01.707067 15953 heartbeater.cc:511] Master 127.12.175.254:41837 requested a full tablet report, sending...
I20260812 11:21:01.708045 15096 ts_manager.cc:194] Registered new tserver with Master: 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:01.708729 15096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:40007
I20260812 11:21:01.714449 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.708962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:33223 (local address 127.12.175.254:41837)
0812 11:21:01.709069 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.709072 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.709083 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:01.709109 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.709111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.709141 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.709207 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.709607 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.710071 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.710819 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.711019 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.711107 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.711981 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.711984 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.711986 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.712006 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.713079 (+ 1073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.713435 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.713439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.713440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.713508 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.713746 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.713749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.713751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.713903 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.713986 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.714221 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.714314 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:21:01.714458 15962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.708376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.12.175.195:33223)
0812 11:21:01.708630 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.708641 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.708709 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.709241 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.709244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.709411 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:01.709498 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.709503 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.710182 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.710185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.710716 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.710724 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.711120 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.711123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.711209 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.711585 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:01.711595 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:01.711861 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:01.713173 (+ 1312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.713177 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.713179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.713351 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.713588 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:01.713591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:01.713593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:01.713667 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:01.713989 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:01.713992 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:01.714078 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.714160 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.714284 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":103,"threads_started":1}
I20260812 11:21:01.717152 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:21:01 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:01.742416 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.734907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36508 (local address 127.12.175.254:41837)
0812 11:21:01.735033 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.735036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.735048 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:01.735081 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.735083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.735118 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.735182 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:01.735884 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.736378 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.737172 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.737382 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.737468 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.739618 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:01.739621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:01.739623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:01.739646 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:01.740900 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.741288 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.741291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.741293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.741369 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:01.741623 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:01.741626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:01.741628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:01.741802 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:01.741932 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.742166 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.742270 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:21:01.745122 15096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:01.748176 15096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:01.761258 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.755898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36473 (local address 127.0.0.1:38938)
0812 11:21:01.756731 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.756778 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.756890 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.757679 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.757684 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.757707 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:01.757817 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.757824 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.758862 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.758866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.760088 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.760097 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.760863 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.760865 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.760944 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.760973 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.761073 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.761156 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260812 11:21:01.761344 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.756051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38938 (local address 127.12.175.194:36473)
0812 11:21:01.757214 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.757227 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.757251 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:21:01.757326 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.757331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.757507 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.757641 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:01.757925 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.758750 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.760203 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.760761 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.760899 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.761031 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.761121 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.761207 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1070,"thread_start_us":105,"threads_started":1}
I20260812 11:21:01.761965 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.756282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:39717 (local address 127.0.0.1:48696)
0812 11:21:01.757189 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.757203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.757304 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.757792 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.757795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.757810 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:01.757889 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.757895 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.759321 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.759324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.760658 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.760665 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.761675 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.761678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.761743 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.761763 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.761809 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.761858 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":844,"mutex_wait_us":43,"thread_start_us":79,"threads_started":1}
I20260812 11:21:01.762094 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.756543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48696 (local address 127.12.175.195:39717)
0812 11:21:01.756939 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.756950 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.757297 (+ 347us) server_negotiation.cc:407] Connection header received
0812 11:21:01.757399 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.757404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.757593 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.757745 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:01.757995 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.759170 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.760779 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.761544 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.761700 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.761818 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.761864 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.761960 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":108,"threads_started":1}
I20260812 11:21:01.763617 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.756054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39909 (local address 127.0.0.1:42900)
0812 11:21:01.757099 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.757111 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.757197 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.757900 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.757904 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.757922 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:01.758013 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.758019 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.759393 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.759396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.760649 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.760662 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.763187 (+ 2525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.763191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:01.763306 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.763331 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:21:01.763406 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 11:21:01.763494 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"mutex_wait_us":94,"thread_start_us":104,"threads_started":1}
I20260812 11:21:01.763691 15990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.756652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.12.175.193:39909)
0812 11:21:01.756961 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.756974 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.757290 (+ 316us) server_negotiation.cc:407] Connection header received
0812 11:21:01.757376 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.757381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.757644 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.757764 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:01.758129 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.759259 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.762274 (+ 3015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:01.763051 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:01.763177 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:01.763318 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:01.763459 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:21:01.763549 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":79,"threads_started":1}
I20260812 11:21:01.764129 15607 tablet_service.cc:1467] Processing CreateTablet for tablet c7a54d55c7cd43c78ceacd52cc6eb044 (DEFAULT_TABLE table=test-table [id=98a00dab96ad430e8b4564df2b7cd49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:01.765115 15607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7a54d55c7cd43c78ceacd52cc6eb044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:01.764734 15836 tablet_service.cc:1467] Processing CreateTablet for tablet c7a54d55c7cd43c78ceacd52cc6eb044 (DEFAULT_TABLE table=test-table [id=98a00dab96ad430e8b4564df2b7cd49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:01.765745 15836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7a54d55c7cd43c78ceacd52cc6eb044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:01.766167 15348 tablet_service.cc:1467] Processing CreateTablet for tablet c7a54d55c7cd43c78ceacd52cc6eb044 (DEFAULT_TABLE table=test-table [id=98a00dab96ad430e8b4564df2b7cd49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:01.767130 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7a54d55c7cd43c78ceacd52cc6eb044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:01.772141 15991 tablet_bootstrap.cc:492] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Bootstrap starting.
I20260812 11:21:01.772990 15997 tablet_bootstrap.cc:492] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Bootstrap starting.
I20260812 11:21:01.774192 15998 tablet_bootstrap.cc:492] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Bootstrap starting.
I20260812 11:21:01.775017 15991 tablet_bootstrap.cc:654] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:01.775063 15997 tablet_bootstrap.cc:654] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:01.775940 15998 tablet_bootstrap.cc:654] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:01.775916 15997 log.cc:824] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:01.776062 15991 log.cc:824] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:01.776777 15998 log.cc:824] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:01.777834 15997 tablet_bootstrap.cc:492] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: No bootstrap required, opened a new log
I20260812 11:21:01.778040 15997 ts_tablet_manager.cc:1397] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260812 11:21:01.778252 15991 tablet_bootstrap.cc:492] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: No bootstrap required, opened a new log
I20260812 11:21:01.778426 15998 tablet_bootstrap.cc:492] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: No bootstrap required, opened a new log
I20260812 11:21:01.778429 15991 ts_tablet_manager.cc:1397] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:21:01.778599 15998 ts_tablet_manager.cc:1397] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:21:01.781275 15998 raft_consensus.cc:348] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:01.781481 15998 raft_consensus.cc:374] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:01.781536 15998 raft_consensus.cc:729] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7746ebbae3174dcfaaf96abe6ee851a5, State: Initialized, Role: FOLLOWER
I20260812 11:21:01.781796 15997 raft_consensus.cc:348] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:01.782065 15997 raft_consensus.cc:374] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:01.782015 15998 consensus_queue.cc:260] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:01.782124 15997 raft_consensus.cc:729] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 806f537e96de4d178a15fa24e1e05f98, State: Initialized, Role: FOLLOWER
I20260812 11:21:01.782282 15991 raft_consensus.cc:348] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:01.782521 15991 raft_consensus.cc:374] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:01.782573 15991 raft_consensus.cc:729] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7284dd8372294487bef5d5e5b7049533, State: Initialized, Role: FOLLOWER
I20260812 11:21:01.782514 15997 consensus_queue.cc:260] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:01.782847 15457 heartbeater.cc:503] Master 127.12.175.254:41837 was elected leader, sending a full tablet report...
I20260812 11:21:01.783027 15998 ts_tablet_manager.cc:1428] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260812 11:21:01.782994 15991 consensus_queue.cc:260] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
W20260812 11:21:01.783131 15459 tablet.cc:2369] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:01.783879 15997 ts_tablet_manager.cc:1428] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 11:21:01.783879 15991 ts_tablet_manager.cc:1428] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:21:01.784209 15724 heartbeater.cc:503] Master 127.12.175.254:41837 was elected leader, sending a full tablet report...
I20260812 11:21:01.785126 15953 heartbeater.cc:503] Master 127.12.175.254:41837 was elected leader, sending a full tablet report...
W20260812 11:21:01.953438 15955 tablet.cc:2369] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:21:01.995437 15725 tablet.cc:2369] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:01.997573 16009 raft_consensus.cc:482] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:01.997736 16009 raft_consensus.cc:504] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:01.998801 16009 leader_election.cc:288] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909), 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:02.003886 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.999198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:37705 (local address 127.12.175.195:39717)
0812 11:21:01.999367 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.999372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.999533 (+ 161us) server_negotiation.cc:407] Connection header received
0812 11:21:01.999643 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.999646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.999690 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.999755 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:01.999987 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.000727 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.002547 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.003165 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.003310 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.003364 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.003679 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.003758 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:02.003886 15990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.999095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:44683 (local address 127.12.175.193:39909)
0812 11:21:01.999284 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:01.999289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:01.999385 (+ 96us) server_negotiation.cc:407] Connection header received
0812 11:21:01.999508 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:01.999511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:01.999568 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:01.999644 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:01.999906 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.000724 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.002547 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.003173 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.003310 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.003364 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.003679 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.003758 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 11:21:02.003906 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.999095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:39717 (local address 127.12.175.194:37705)
0812 11:21:01.999446 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.999458 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.999544 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.999778 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.999781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.999793 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:01.999885 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.999891 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.000828 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.000831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.002408 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.002420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.003296 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.003300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.003496 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.003540 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.003618 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.003718 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":218,"thread_start_us":65,"threads_started":1}
I20260812 11:21:02.003906 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:01.998982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39909 (local address 127.12.175.194:44683)
0812 11:21:01.999281 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:01.999296 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:01.999408 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:01.999658 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:01.999661 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:01.999674 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:01.999797 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:01.999804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.000828 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.000831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.002407 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.002420 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.003296 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.003300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.003500 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.003552 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.003618 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.003718 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":243,"thread_start_us":80,"threads_started":1}
I20260812 11:21:02.004550 15381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a54d55c7cd43c78ceacd52cc6eb044" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" is_pre_election: true
I20260812 11:21:02.004563 15867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a54d55c7cd43c78ceacd52cc6eb044" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806f537e96de4d178a15fa24e1e05f98" is_pre_election: true
I20260812 11:21:02.004818 15381 raft_consensus.cc:2454] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 0.
I20260812 11:21:02.004837 15867 raft_consensus.cc:2454] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 0.
I20260812 11:21:02.005261 15508 leader_election.cc:302] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7284dd8372294487bef5d5e5b7049533, 7746ebbae3174dcfaaf96abe6ee851a5; no voters:
I20260812 11:21:02.005491 16009 raft_consensus.cc:2781] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:02.005584 16009 raft_consensus.cc:482] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:02.005633 16009 raft_consensus.cc:3037] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.007042 16009 raft_consensus.cc:504] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.007388 16009 leader_election.cc:288] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 election: Requested vote from peers 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909), 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:02.007666 15381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a54d55c7cd43c78ceacd52cc6eb044" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7746ebbae3174dcfaaf96abe6ee851a5"
I20260812 11:21:02.007710 15867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a54d55c7cd43c78ceacd52cc6eb044" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806f537e96de4d178a15fa24e1e05f98"
I20260812 11:21:02.007781 15381 raft_consensus.cc:3037] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.007808 15867 raft_consensus.cc:3037] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.008864 15381 raft_consensus.cc:2454] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 1.
I20260812 11:21:02.009173 15867 raft_consensus.cc:2454] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 1.
I20260812 11:21:02.009166 15508 leader_election.cc:302] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7284dd8372294487bef5d5e5b7049533, 7746ebbae3174dcfaaf96abe6ee851a5; no voters:
I20260812 11:21:02.009333 16009 raft_consensus.cc:2781] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:02.009505 16009 raft_consensus.cc:686] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 1 LEADER]: Becoming Leader. State: Replica: 7284dd8372294487bef5d5e5b7049533, State: Running, Role: LEADER
I20260812 11:21:02.009796 16009 consensus_queue.cc:237] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.012712 15093 catalog_manager.cc:5495] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7284dd8372294487bef5d5e5b7049533 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "7284dd8372294487bef5d5e5b7049533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:02.057171 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.053873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38946 (local address 127.12.175.194:36473)
0812 11:21:02.053982 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.053985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.054056 (+ 71us) server_negotiation.cc:407] Connection header received
0812 11:21:02.054235 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.054237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.054290 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.054368 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:02.054569 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.055067 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.055893 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.056116 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.056193 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.056474 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.056833 (+ 359us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.056910 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.057005 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.057067 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:02.062314 15381 raft_consensus.cc:1261] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Refusing update from remote peer 7284dd8372294487bef5d5e5b7049533: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:02.062352 15867 raft_consensus.cc:1261] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Refusing update from remote peer 7284dd8372294487bef5d5e5b7049533: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:02.062933 16009 consensus_queue.cc:1035] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:02.063107 16013 consensus_queue.cc:1035] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:02.069360 16016 mvcc.cc:205] Tried to move back new op lower bound from 7317641879801315328 to 7317641879594360832. Current Snapshot: MvccSnapshot[applied={T|T < 7317641879801315328}]
I20260812 11:21:02.070842 16020 mvcc.cc:205] Tried to move back new op lower bound from 7317641879801315328 to 7317641879594360832. Current Snapshot: MvccSnapshot[applied={T|T < 7317641879801315328 or (T in {7317641879801315328})}]
I20260812 11:21:02.080896 15096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:02.081070 15096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:02.083406 15096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: Sending DeleteTablet for 3 replicas of tablet c7a54d55c7cd43c78ceacd52cc6eb044
I20260812 11:21:02.084285 15607 tablet_service.cc:1514] Processing DeleteTablet for tablet c7a54d55c7cd43c78ceacd52cc6eb044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:38938
I20260812 11:21:02.084512 15836 tablet_service.cc:1514] Processing DeleteTablet for tablet c7a54d55c7cd43c78ceacd52cc6eb044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:48696
I20260812 11:21:02.084934 16036 tablet_replica.cc:330] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: stopping tablet replica
I20260812 11:21:02.084934 16034 tablet_replica.cc:330] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: stopping tablet replica
I20260812 11:21:02.084933 15348 tablet_service.cc:1514] Processing DeleteTablet for tablet c7a54d55c7cd43c78ceacd52cc6eb044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42900
I20260812 11:21:02.085230 16034 raft_consensus.cc:2229] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:02.085229 16036 raft_consensus.cc:2229] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:02.085521 16036 raft_consensus.cc:2258] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:02.085601 16034 raft_consensus.cc:2258] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:02.086011 16039 tablet_replica.cc:330] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: stopping tablet replica
I20260812 11:21:02.086290 16039 raft_consensus.cc:2229] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:02.086464 15096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:21:02.086575 16039 raft_consensus.cc:2258] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:02.087018 16034 ts_tablet_manager.cc:1905] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:21:02.087024 15096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:02.087885 16039 ts_tablet_manager.cc:1905] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:02.089738 16034 ts_tablet_manager.cc:1918] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:02.089833 16034 log.cc:1196] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/c7a54d55c7cd43c78ceacd52cc6eb044
I20260812 11:21:02.090133 16034 ts_tablet_manager.cc:1939] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7284dd8372294487bef5d5e5b7049533: Deleting consensus metadata
I20260812 11:21:02.090412 16039 ts_tablet_manager.cc:1918] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:02.090500 16039 log.cc:1196] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/c7a54d55c7cd43c78ceacd52cc6eb044
I20260812 11:21:02.090772 16039 ts_tablet_manager.cc:1939] T c7a54d55c7cd43c78ceacd52cc6eb044 P 7746ebbae3174dcfaaf96abe6ee851a5: Deleting consensus metadata
I20260812 11:21:02.091255 15068 catalog_manager.cc:4841] TS 7284dd8372294487bef5d5e5b7049533 (127.12.175.194:36473): tablet c7a54d55c7cd43c78ceacd52cc6eb044 (table test-table [id=98a00dab96ad430e8b4564df2b7cd49f]) successfully deleted
I20260812 11:21:02.092233 15607 tablet_service.cc:1467] Processing CreateTablet for tablet 292814fe780642d7895508150e310711 (DEFAULT_TABLE table=test-table [id=03d0dbd019df4ea3890db576f00facd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:02.092401 15836 tablet_service.cc:1467] Processing CreateTablet for tablet 292814fe780642d7895508150e310711 (DEFAULT_TABLE table=test-table [id=03d0dbd019df4ea3890db576f00facd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:02.092473 15607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 292814fe780642d7895508150e310711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:02.092448 15348 tablet_service.cc:1467] Processing CreateTablet for tablet 292814fe780642d7895508150e310711 (DEFAULT_TABLE table=test-table [id=03d0dbd019df4ea3890db576f00facd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:02.092633 15836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 292814fe780642d7895508150e310711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:02.092677 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 292814fe780642d7895508150e310711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:02.094741 15998 tablet_bootstrap.cc:492] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Bootstrap starting.
I20260812 11:21:02.095017 15991 tablet_bootstrap.cc:492] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Bootstrap starting.
I20260812 11:21:02.095391 15997 tablet_bootstrap.cc:492] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Bootstrap starting.
I20260812 11:21:02.095676 15998 tablet_bootstrap.cc:654] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:02.096120 16036 ts_tablet_manager.cc:1905] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:02.096374 15997 tablet_bootstrap.cc:654] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:02.097452 15997 tablet_bootstrap.cc:492] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: No bootstrap required, opened a new log
I20260812 11:21:02.097525 15997 ts_tablet_manager.cc:1397] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:02.097936 15991 tablet_bootstrap.cc:654] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:02.097942 15997 raft_consensus.cc:348] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.098037 15997 raft_consensus.cc:374] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:02.098068 15997 raft_consensus.cc:729] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 806f537e96de4d178a15fa24e1e05f98, State: Initialized, Role: FOLLOWER
I20260812 11:21:02.098187 15997 consensus_queue.cc:260] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.098423 15997 ts_tablet_manager.cc:1428] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:02.098587 15071 catalog_manager.cc:4841] TS 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909): tablet c7a54d55c7cd43c78ceacd52cc6eb044 (table test-table [id=98a00dab96ad430e8b4564df2b7cd49f]) successfully deleted
I20260812 11:21:02.098419 16036 ts_tablet_manager.cc:1918] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:02.098707 16036 log.cc:1196] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/c7a54d55c7cd43c78ceacd52cc6eb044
I20260812 11:21:02.099012 16036 ts_tablet_manager.cc:1939] T c7a54d55c7cd43c78ceacd52cc6eb044 P 806f537e96de4d178a15fa24e1e05f98: Deleting consensus metadata
I20260812 11:21:02.100101 15069 catalog_manager.cc:4841] TS 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717): tablet c7a54d55c7cd43c78ceacd52cc6eb044 (table test-table [id=98a00dab96ad430e8b4564df2b7cd49f]) successfully deleted
I20260812 11:21:02.100915 15991 tablet_bootstrap.cc:492] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: No bootstrap required, opened a new log
I20260812 11:21:02.100991 15991 ts_tablet_manager.cc:1397] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 11:21:02.101230 15998 tablet_bootstrap.cc:492] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: No bootstrap required, opened a new log
I20260812 11:21:02.101317 15998 ts_tablet_manager.cc:1397] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 11:21:02.101384 15991 raft_consensus.cc:348] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.101481 15991 raft_consensus.cc:374] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:02.101541 15991 raft_consensus.cc:729] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7284dd8372294487bef5d5e5b7049533, State: Initialized, Role: FOLLOWER
I20260812 11:21:02.101665 15991 consensus_queue.cc:260] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.101709 15998 raft_consensus.cc:348] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.101818 15998 raft_consensus.cc:374] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:02.101855 15998 raft_consensus.cc:729] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7746ebbae3174dcfaaf96abe6ee851a5, State: Initialized, Role: FOLLOWER
I20260812 11:21:02.101918 15991 ts_tablet_manager.cc:1428] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:02.102000 15998 consensus_queue.cc:260] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.102252 15998 ts_tablet_manager.cc:1428] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:02.243180 16009 raft_consensus.cc:482] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:02.243333 16009 raft_consensus.cc:504] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.243752 16009 leader_election.cc:288] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909), 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:02.244267 15381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292814fe780642d7895508150e310711" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" is_pre_election: true
I20260812 11:21:02.244267 15867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292814fe780642d7895508150e310711" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806f537e96de4d178a15fa24e1e05f98" is_pre_election: true
I20260812 11:21:02.244428 15867 raft_consensus.cc:2454] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 0.
I20260812 11:21:02.244437 15381 raft_consensus.cc:2454] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 0.
I20260812 11:21:02.244735 15508 leader_election.cc:302] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7284dd8372294487bef5d5e5b7049533, 7746ebbae3174dcfaaf96abe6ee851a5; no voters:
I20260812 11:21:02.244961 16009 raft_consensus.cc:2781] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:02.245025 16009 raft_consensus.cc:482] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:02.245057 16009 raft_consensus.cc:3037] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.245992 16009 raft_consensus.cc:504] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.246321 16009 leader_election.cc:288] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 election: Requested vote from peers 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909), 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:02.246666 15867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292814fe780642d7895508150e310711" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806f537e96de4d178a15fa24e1e05f98"
I20260812 11:21:02.246666 15381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292814fe780642d7895508150e310711" candidate_uuid: "7284dd8372294487bef5d5e5b7049533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7746ebbae3174dcfaaf96abe6ee851a5"
I20260812 11:21:02.246798 15381 raft_consensus.cc:3037] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.246798 15867 raft_consensus.cc:3037] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.247972 15381 raft_consensus.cc:2454] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 1.
I20260812 11:21:02.247996 15867 raft_consensus.cc:2454] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7284dd8372294487bef5d5e5b7049533 in term 1.
I20260812 11:21:02.248282 15506 leader_election.cc:302] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7284dd8372294487bef5d5e5b7049533, 806f537e96de4d178a15fa24e1e05f98; no voters:
I20260812 11:21:02.248473 16009 raft_consensus.cc:2781] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:02.248555 16009 raft_consensus.cc:686] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 1 LEADER]: Becoming Leader. State: Replica: 7284dd8372294487bef5d5e5b7049533, State: Running, Role: LEADER
I20260812 11:21:02.248674 16009 consensus_queue.cc:237] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.250274 15093 catalog_manager.cc:5495] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7284dd8372294487bef5d5e5b7049533 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "7284dd8372294487bef5d5e5b7049533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } health_report { overall_health: UNKNOWN } } }
Aug 12 11:21:02 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533660, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:02.316095 16051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.308685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:41837 (local address 127.0.0.1:36520)
0812 11:21:02.308979 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:02.308992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:02.309081 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:02.309284 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:02.309286 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:02.309634 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:02.309726 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.309731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.310411 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.310413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.310975 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.310982 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.311375 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.311377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.311438 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.311899 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:02.311910 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:02.313235 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:02.314812 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:02.314821 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:02.314826 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:02.315048 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:02.315254 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:02.315256 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:02.315258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:02.315362 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:02.315653 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:02.315658 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:02.315752 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.315834 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.315970 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":97,"threads_started":1}
I20260812 11:21:02.316185 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.308738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36520 (local address 127.12.175.254:41837)
0812 11:21:02.308965 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.308972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.309038 (+ 66us) server_negotiation.cc:407] Connection header received
0812 11:21:02.309147 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.309149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.309187 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.309258 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:02.309808 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.310336 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.311054 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.311291 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.311372 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.313356 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:02.313359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:02.313361 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:02.313382 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:02.314717 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:02.315119 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:02.315121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:02.315123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:02.315193 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:02.315425 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:02.315427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:02.315428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:02.315580 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:02.315650 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.315874 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.316033 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":161,"thread_start_us":84,"threads_started":1}
I20260812 11:21:02.319401 15093 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:36520:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:21:02.320111 15093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:02.324621 15348 tablet_service.cc:1467] Processing CreateTablet for tablet 704b18a3a0a54464a3232d81748b6ec8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f5bdab0eea946c28dacbedcc7e4f248]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:02.324733 15836 tablet_service.cc:1467] Processing CreateTablet for tablet 704b18a3a0a54464a3232d81748b6ec8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f5bdab0eea946c28dacbedcc7e4f248]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:02.324719 15607 tablet_service.cc:1467] Processing CreateTablet for tablet 704b18a3a0a54464a3232d81748b6ec8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f5bdab0eea946c28dacbedcc7e4f248]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:02.325004 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704b18a3a0a54464a3232d81748b6ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:02.325085 15836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704b18a3a0a54464a3232d81748b6ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:02.325085 15607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704b18a3a0a54464a3232d81748b6ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:02.327510 15998 tablet_bootstrap.cc:492] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: Bootstrap starting.
I20260812 11:21:02.327852 15997 tablet_bootstrap.cc:492] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: Bootstrap starting.
I20260812 11:21:02.328075 15991 tablet_bootstrap.cc:492] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: Bootstrap starting.
I20260812 11:21:02.328388 15998 tablet_bootstrap.cc:654] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:02.328723 15991 tablet_bootstrap.cc:654] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:02.328720 15997 tablet_bootstrap.cc:654] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:02.329577 15998 tablet_bootstrap.cc:492] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: No bootstrap required, opened a new log
I20260812 11:21:02.329667 15998 ts_tablet_manager.cc:1397] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:02.329896 15991 tablet_bootstrap.cc:492] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: No bootstrap required, opened a new log
I20260812 11:21:02.329982 15991 ts_tablet_manager.cc:1397] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:02.330085 15997 tablet_bootstrap.cc:492] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: No bootstrap required, opened a new log
I20260812 11:21:02.330166 15997 ts_tablet_manager.cc:1397] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:02.330132 15998 raft_consensus.cc:348] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.330232 15998 raft_consensus.cc:374] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:02.330271 15998 raft_consensus.cc:729] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7746ebbae3174dcfaaf96abe6ee851a5, State: Initialized, Role: FOLLOWER
I20260812 11:21:02.330365 15991 raft_consensus.cc:348] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.330402 15998 consensus_queue.cc:260] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.330467 15991 raft_consensus.cc:374] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:02.330513 15991 raft_consensus.cc:729] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7284dd8372294487bef5d5e5b7049533, State: Initialized, Role: FOLLOWER
I20260812 11:21:02.330662 15998 ts_tablet_manager.cc:1428] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:02.330626 15991 consensus_queue.cc:260] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.330618 15997 raft_consensus.cc:348] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.330724 15997 raft_consensus.cc:374] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:02.330761 15997 raft_consensus.cc:729] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 806f537e96de4d178a15fa24e1e05f98, State: Initialized, Role: FOLLOWER
I20260812 11:21:02.330875 15991 ts_tablet_manager.cc:1428] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:02.330875 15997 consensus_queue.cc:260] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.331058 16009 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.331089 16007 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.331175 16009 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.331226 16007 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.331480 16006 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.331610 16006 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.331926 15997 ts_tablet_manager.cc:1428] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:02.363157 16006 raft_consensus.cc:482] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:02.363256 16006 raft_consensus.cc:504] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.364400 16006 leader_election.cc:288] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7284dd8372294487bef5d5e5b7049533 (127.12.175.194:36473), 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:02.368057 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.364710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:50699 (local address 127.12.175.195:39717)
0812 11:21:02.364817 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.364821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.365067 (+ 246us) server_negotiation.cc:407] Connection header received
0812 11:21:02.365164 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.365166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.365209 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.365279 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:02.365526 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.365998 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.367118 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.367525 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.367617 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.367669 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.367875 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.367942 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:02.368072 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.364647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:49449 (local address 127.12.175.194:36473)
0812 11:21:02.364760 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.364766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.364995 (+ 229us) server_negotiation.cc:407] Connection header received
0812 11:21:02.365092 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.365095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.365144 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.365205 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:02.365486 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.365985 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.367096 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.367548 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.367658 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.367710 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.367897 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.367966 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:02.368088 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.364621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:39717 (local address 127.12.175.193:50699)
0812 11:21:02.364951 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:02.364978 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:02.365084 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:02.365302 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:02.365305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:02.365319 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:02.365414 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.365418 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.366128 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.366130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.366998 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.367006 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.367631 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.367634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.367737 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.367781 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.367839 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.367904 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":82,"thread_start_us":114,"threads_started":1}
I20260812 11:21:02.368111 16058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.364592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36473 (local address 127.12.175.193:49449)
0812 11:21:02.364904 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:02.364916 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:02.365012 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:02.365229 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:02.365232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:02.365246 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:02.365373 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.365380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.366096 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.366100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.366973 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.366989 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.367668 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.367671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.367783 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.367800 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.367868 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.367933 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":25,"thread_start_us":130,"threads_started":1}
I20260812 11:21:02.368521 15867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704b18a3a0a54464a3232d81748b6ec8" candidate_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806f537e96de4d178a15fa24e1e05f98" is_pre_election: true
I20260812 11:21:02.368662 15867 raft_consensus.cc:2454] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7746ebbae3174dcfaaf96abe6ee851a5 in term 0.
I20260812 11:21:02.368723 15636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704b18a3a0a54464a3232d81748b6ec8" candidate_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7284dd8372294487bef5d5e5b7049533" is_pre_election: true
I20260812 11:21:02.368937 15636 raft_consensus.cc:2454] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7746ebbae3174dcfaaf96abe6ee851a5 in term 0.
I20260812 11:21:02.368979 15263 leader_election.cc:302] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7746ebbae3174dcfaaf96abe6ee851a5, 806f537e96de4d178a15fa24e1e05f98; no voters:
I20260812 11:21:02.369251 16006 raft_consensus.cc:2781] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:02.369310 16006 raft_consensus.cc:482] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:02.369352 16006 raft_consensus.cc:3037] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.370438 16006 raft_consensus.cc:504] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.370731 16006 leader_election.cc:288] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [CANDIDATE]: Term 1 election: Requested vote from peers 7284dd8372294487bef5d5e5b7049533 (127.12.175.194:36473), 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717)
I20260812 11:21:02.371035 15867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704b18a3a0a54464a3232d81748b6ec8" candidate_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806f537e96de4d178a15fa24e1e05f98"
I20260812 11:21:02.371068 15636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704b18a3a0a54464a3232d81748b6ec8" candidate_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7284dd8372294487bef5d5e5b7049533"
I20260812 11:21:02.371130 15867 raft_consensus.cc:3037] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.371165 15636 raft_consensus.cc:3037] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:02.371960 15867 raft_consensus.cc:2454] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7746ebbae3174dcfaaf96abe6ee851a5 in term 1.
I20260812 11:21:02.372139 15636 raft_consensus.cc:2454] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7746ebbae3174dcfaaf96abe6ee851a5 in term 1.
I20260812 11:21:02.372221 15263 leader_election.cc:302] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7746ebbae3174dcfaaf96abe6ee851a5, 806f537e96de4d178a15fa24e1e05f98; no voters:
I20260812 11:21:02.372375 16006 raft_consensus.cc:2781] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:02.372584 16006 raft_consensus.cc:686] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 LEADER]: Becoming Leader. State: Replica: 7746ebbae3174dcfaaf96abe6ee851a5, State: Running, Role: LEADER
I20260812 11:21:02.372800 16006 consensus_queue.cc:237] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } }
I20260812 11:21:02.373905 16060 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: TxnStatusTablet state changed. Reason: New leader 7746ebbae3174dcfaaf96abe6ee851a5. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.374008 16060 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:02.374394 16065 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:21:02.374532 16065 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:21:02.374958 15097 catalog_manager.cc:5495] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:02.394860 15990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.391542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42902 (local address 127.12.175.193:39909)
0812 11:21:02.391660 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.391665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.391724 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:21:02.391896 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.391899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.391950 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.392030 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:02.392253 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.392744 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.393560 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.393782 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.393867 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.394150 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.394513 (+ 363us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.394627 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.394695 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.394743 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 11:21:02.394876 16051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.391499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39909 (local address 127.0.0.1:42902)
0812 11:21:02.391656 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:02.391669 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:02.391772 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:02.392053 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:02.392056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:02.392064 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:02.392162 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.392168 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.392839 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.392843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.393461 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.393471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.393876 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.393880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.393978 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.394022 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.394605 (+ 583us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.394621 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.394686 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.394768 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 11:21:02.397467 15867 raft_consensus.cc:1261] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Refusing update from remote peer 7746ebbae3174dcfaaf96abe6ee851a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:02.397523 15636 raft_consensus.cc:1261] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Refusing update from remote peer 7746ebbae3174dcfaaf96abe6ee851a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:02.397902 16006 consensus_queue.cc:1035] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:02.398082 16060 consensus_queue.cc:1035] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:02.399703 16007 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: TxnStatusTablet state changed. Reason: New leader 7746ebbae3174dcfaaf96abe6ee851a5. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.399806 16007 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.400470 16009 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: TxnStatusTablet state changed. Reason: New leader 7746ebbae3174dcfaaf96abe6ee851a5. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.400578 16009 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.401767 16006 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.401857 16006 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:02.401988 16006 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.402060 16006 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7746ebbae3174dcfaaf96abe6ee851a5: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:02.403318 16021 mvcc.cc:205] Tried to move back new op lower bound from 7317641881175318528 to 7317641881081393152. Current Snapshot: MvccSnapshot[applied={T|T < 7317641881175318528}]
I20260812 11:21:02.403625 16007 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.403719 16007 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 806f537e96de4d178a15fa24e1e05f98: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.403702 16009 tablet_replica.cc:439] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 } } peers { permanent_uuid: "7284dd8372294487bef5d5e5b7049533" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36473 } } peers { permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 } } }
I20260812 11:21:02.403781 16009 tablet_replica.cc:442] T 704b18a3a0a54464a3232d81748b6ec8 P 7284dd8372294487bef5d5e5b7049533: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:02.416153 15990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.412801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:51673 (local address 127.12.175.193:39909)
0812 11:21:02.412892 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.412895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.413134 (+ 239us) server_negotiation.cc:407] Connection header received
0812 11:21:02.413248 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.413250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.413284 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.413339 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:02.413578 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.414075 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.415244 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.415488 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.415557 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.415841 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.415898 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.415938 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.416031 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.416067 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 11:21:02.416249 16078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.412724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39909 (local address 127.12.175.194:51673)
0812 11:21:02.413061 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:02.413075 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:02.413173 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:02.413359 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:02.413362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:02.413369 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:02.413467 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.413473 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.414166 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.414169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.415146 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.415157 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.415579 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.415583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.415677 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.415728 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.415958 (+ 230us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.415963 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.416025 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.416109 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":94,"threads_started":1}
I20260812 11:21:02.421859 15381 raft_consensus.cc:1261] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Refusing update from remote peer 7284dd8372294487bef5d5e5b7049533: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:02.421924 15867 raft_consensus.cc:1261] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Refusing update from remote peer 7284dd8372294487bef5d5e5b7049533: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:02.422279 16009 consensus_queue.cc:1035] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "806f537e96de4d178a15fa24e1e05f98" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:02.422451 16013 consensus_queue.cc:1035] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7746ebbae3174dcfaaf96abe6ee851a5" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:02.443163 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.439801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:40775 (local address 127.12.175.194:36473)
0812 11:21:02.439907 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.439911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.440162 (+ 251us) server_negotiation.cc:407] Connection header received
0812 11:21:02.440310 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.440313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.440362 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.440428 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:02.440722 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.441391 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.442217 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.442434 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.442524 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.442787 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.442853 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.442909 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.443002 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.443049 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:02.443457 16085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.439707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36473 (local address 127.12.175.193:40775)
0812 11:21:02.440086 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:02.440100 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:02.440209 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:02.440523 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:02.440525 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:02.440532 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:02.440619 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.440623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.441478 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.441481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.442111 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:02.442120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.442532 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.442536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:02.442633 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.442673 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:02.442922 (+ 249us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:02.442928 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:21:02.442992 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:21:02.443325 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":104,"threads_started":1}
I20260812 11:21:02.462003 15096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:02.462126 15096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:02.463851 15096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 633f5bd009ad4a0d973ab4852f22c6ea: Sending DeleteTablet for 3 replicas of tablet 292814fe780642d7895508150e310711
I20260812 11:21:02.464387 15607 tablet_service.cc:1514] Processing DeleteTablet for tablet 292814fe780642d7895508150e310711 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:38938
I20260812 11:21:02.464416 15836 tablet_service.cc:1514] Processing DeleteTablet for tablet 292814fe780642d7895508150e310711 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:48696
I20260812 11:21:02.464568 16034 tablet_replica.cc:330] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: stopping tablet replica
I20260812 11:21:02.464574 16036 tablet_replica.cc:330] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: stopping tablet replica
I20260812 11:21:02.464677 16034 raft_consensus.cc:2229] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:02.464677 16036 raft_consensus.cc:2229] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:02.464776 16036 raft_consensus.cc:2258] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:02.464836 16034 raft_consensus.cc:2258] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:02.465451 16036 ts_tablet_manager.cc:1905] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:02.465608 16034 ts_tablet_manager.cc:1905] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:02.467401 15348 tablet_service.cc:1514] Processing DeleteTablet for tablet 292814fe780642d7895508150e310711 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42900
I20260812 11:21:02.467571 16039 tablet_replica.cc:330] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: stopping tablet replica
I20260812 11:21:02.467664 16039 raft_consensus.cc:2229] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:02.467664 16036 ts_tablet_manager.cc:1918] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:02.467722 16036 log.cc:1196] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/292814fe780642d7895508150e310711
I20260812 11:21:02.467754 16039 raft_consensus.cc:2258] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:02.468227 16034 ts_tablet_manager.cc:1918] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:02.468299 16034 log.cc:1196] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/292814fe780642d7895508150e310711
I20260812 11:21:02.468423 16039 ts_tablet_manager.cc:1905] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:02.468544 16034 ts_tablet_manager.cc:1939] T 292814fe780642d7895508150e310711 P 7284dd8372294487bef5d5e5b7049533: Deleting consensus metadata
I20260812 11:21:02.469134 15068 catalog_manager.cc:4841] TS 7284dd8372294487bef5d5e5b7049533 (127.12.175.194:36473): tablet 292814fe780642d7895508150e310711 (table test-table [id=03d0dbd019df4ea3890db576f00facd0]) successfully deleted
I20260812 11:21:02.470983 16039 ts_tablet_manager.cc:1918] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:02.471064 16039 log.cc:1196] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/292814fe780642d7895508150e310711
I20260812 11:21:02.471335 16039 ts_tablet_manager.cc:1939] T 292814fe780642d7895508150e310711 P 7746ebbae3174dcfaaf96abe6ee851a5: Deleting consensus metadata
I20260812 11:21:02.471906 15071 catalog_manager.cc:4841] TS 7746ebbae3174dcfaaf96abe6ee851a5 (127.12.175.193:39909): tablet 292814fe780642d7895508150e310711 (table test-table [id=03d0dbd019df4ea3890db576f00facd0]) successfully deleted
I20260812 11:21:02.471967 16036 ts_tablet_manager.cc:1939] T 292814fe780642d7895508150e310711 P 806f537e96de4d178a15fa24e1e05f98: Deleting consensus metadata
I20260812 11:21:02.472486 15069 catalog_manager.cc:4841] TS 806f537e96de4d178a15fa24e1e05f98 (127.12.175.195:39717): tablet 292814fe780642d7895508150e310711 (table test-table [id=03d0dbd019df4ea3890db576f00facd0]) successfully deleted
Aug 12 11:21:02 dist-test-slave-gjrz krb5kdc[15006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533661, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:21:02.479425 15990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.469302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42904 (local address 127.12.175.193:39909)
0812 11:21:02.469407 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.469411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.469837 (+ 426us) server_negotiation.cc:407] Connection header received
0812 11:21:02.469958 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.469960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.470003 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.470080 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:02.470897 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.471719 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.472894 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.473113 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.473203 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.476342 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:02.476352 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:02.476363 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:02.476385 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:02.477784 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:02.478221 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:02.478225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:02.478226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:02.478296 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:02.478548 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:02.478550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:02.478551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:02.478766 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:02.478912 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.479157 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.479250 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 11:21:02.479758 15445 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42904
I20260812 11:21:02.488600 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:02.481203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36528 (local address 127.12.175.254:41837)
0812 11:21:02.481323 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:02.481327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:02.481492 (+ 165us) server_negotiation.cc:407] Connection header received
0812 11:21:02.481615 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:02.481617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:02.481654 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:02.481714 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:02.482454 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.482942 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.484041 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:02.484316 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:02.484410 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:02.485853 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:02.485856 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:02.485858 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:02.485883 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:02.487176 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:02.487641 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:02.487643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:02.487644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:02.487716 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:02.487948 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:02.487950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:02.487951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:02.488098 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:02.488189 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:02.488394 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 11:21:02.488492 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 11:21:02.488948 15096 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36528
I20260812 11:21:02.490085 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15229
I20260812 11:21:02.510120 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15477
I20260812 11:21:02.524515 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15737
I20260812 11:21:02.535328 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15036
2026-08-12T11:21:02Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2989 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:02 dist-test-slave-gjrz krb5kdc[16098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:02 dist-test-slave-gjrz krb5kdc[16098](info): set up 2 sockets
Aug 12 11:21:02 dist-test-slave-gjrz krb5kdc[16098](info): commencing operation
krb5kdc: starting...
W20260812 11:21:03.733700 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:03 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:03.845780 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38355
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:03.950619 16125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:03.950825 16125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:03.950860 16125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:03.954759 16125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:03.954806 16125 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:21:03.954821 16125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:03.954838 16125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:03.954864 16125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:03.954893 16125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:03.959802 16125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38355
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:03.960646 16125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:03.961531 16125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:03.969429 16132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:03.969419 16138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:03.969424 16141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:03.969473 16125 server_base.cc:1034] running on GCE node
I20260812 11:21:03.970129 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:03.971102 16125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:03.972255 16125 hybrid_clock.cc:648] HybridClock initialized: now 1786533663972248 us; error 40 us; skew 500 ppm
Aug 12 11:21:03 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533663, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:03.974754 16125 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:03.975543 16125 webserver.cc:460] Webserver started at http://127.12.175.254:33971/ using document root <none> and password file <none>
I20260812 11:21:03.975998 16125 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:03.976064 16125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:03.976214 16125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:03.978017 16125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "356f2077d2fb4edb97f10bcc932f2126"
format_stamp: "Formatted at 2026-08-12 11:21:03 on dist-test-slave-gjrz"
server_key: "12a3ff23f4c8fcd0b5876b1bcf3d2fc9"
server_key_iv: "012df6e0c665fb7cc04e5c4bfa947ed9"
server_key_version: "encryptionkey@0"
I20260812 11:21:03.978498 16125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "356f2077d2fb4edb97f10bcc932f2126"
format_stamp: "Formatted at 2026-08-12 11:21:03 on dist-test-slave-gjrz"
server_key: "12a3ff23f4c8fcd0b5876b1bcf3d2fc9"
server_key_iv: "012df6e0c665fb7cc04e5c4bfa947ed9"
server_key_version: "encryptionkey@0"
I20260812 11:21:03.981914 16125 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:21:03.984076 16153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:03.985302 16125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:03.985402 16125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "356f2077d2fb4edb97f10bcc932f2126"
format_stamp: "Formatted at 2026-08-12 11:21:03 on dist-test-slave-gjrz"
server_key: "12a3ff23f4c8fcd0b5876b1bcf3d2fc9"
server_key_iv: "012df6e0c665fb7cc04e5c4bfa947ed9"
server_key_version: "encryptionkey@0"
I20260812 11:21:03.985481 16125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:04.001412 16125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:04.004135 16125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:04.004268 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:04.011158 16125 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:38355
I20260812 11:21:04.011215 16269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:38355 every 8 connection(s)
I20260812 11:21:04.011993 16125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:04.014565 16270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.019721 16270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Bootstrap starting.
I20260812 11:21:04.020887 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16125
I20260812 11:21:04.020977 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:04.021203 12991 external_mini_cluster.cc:1428] Setting key 3889d509dee2d6fa9fad4131e51705e3
I20260812 11:21:04.022142 16270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.022967 16270 log.cc:824] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:04.025019 16270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: No bootstrap required, opened a new log
I20260812 11:21:04.028836 16270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f2077d2fb4edb97f10bcc932f2126" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38355 } }
I20260812 11:21:04.029038 16270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.029071 16270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356f2077d2fb4edb97f10bcc932f2126, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.029462 16270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f2077d2fb4edb97f10bcc932f2126" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38355 } }
I20260812 11:21:04.029587 16270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:04.029654 16270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:04.029750 16270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.030690 16270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f2077d2fb4edb97f10bcc932f2126" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38355 } }
I20260812 11:21:04.031054 16270 leader_election.cc:302] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 356f2077d2fb4edb97f10bcc932f2126; no voters:
I20260812 11:21:04.031395 16270 leader_election.cc:288] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:04.031483 16278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:04.031697 16278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [term 1 LEADER]: Becoming Leader. State: Replica: 356f2077d2fb4edb97f10bcc932f2126, State: Running, Role: LEADER
I20260812 11:21:04.031972 16278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f2077d2fb4edb97f10bcc932f2126" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38355 } }
I20260812 11:21:04.032588 16270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:04.033222 16282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 356f2077d2fb4edb97f10bcc932f2126. Latest consensus state: current_term: 1 leader_uuid: "356f2077d2fb4edb97f10bcc932f2126" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f2077d2fb4edb97f10bcc932f2126" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38355 } } }
I20260812 11:21:04.033342 16282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:04.034037 16279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "356f2077d2fb4edb97f10bcc932f2126" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f2077d2fb4edb97f10bcc932f2126" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38355 } } }
I20260812 11:21:04.034217 16279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:04.034861 16290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:04.035763 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.022166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60872 (local address 127.12.175.254:38355)
0812 11:21:04.022593 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.022611 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.022651 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:21:04.023447 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.023466 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.023792 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.024129 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.024751 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.026203 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.027027 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.027754 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.027905 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.030256 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.030262 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.030278 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.030307 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.032186 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.032655 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.032662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.032668 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.032801 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.033125 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.033128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.033130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.033646 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.033831 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.034562 (+ 731us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.034850 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":140,"threads_started":1}
I20260812 11:21:04.038076 16290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:04.043308 16290 catalog_manager.cc:1347] Generated new cluster ID: 71f78ad9e7c04e73a0afba2ac27e393c
I20260812 11:21:04.043368 16290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:04.050556 16290 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:04.051554 16290 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:04.057770 16290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Generated new TSK 0
I20260812 11:21:04.058337 16290 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:04.092017 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38355
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:04.198845 16310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:04.199069 16310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:04.199115 16310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:04.202956 16310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:04.203009 16310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:04.203052 16310 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:21:04.203079 16310 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:04.203119 16310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:04.208020 16310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:04.208858 16310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:04.209733 16310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:04.218498 16328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:04.218473 16324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:04.218519 16325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:04.218462 16310 server_base.cc:1034] running on GCE node
I20260812 11:21:04.219089 16310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:04.219642 16310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:04.220803 16310 hybrid_clock.cc:648] HybridClock initialized: now 1786533664220783 us; error 31 us; skew 500 ppm
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:04.223361 16310 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:04.224121 16310 webserver.cc:460] Webserver started at http://127.12.175.193:41065/ using document root <none> and password file <none>
I20260812 11:21:04.224588 16310 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:04.224642 16310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:04.224797 16310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:04.226629 16310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "edbda51bce9f40e182034d64e3bc850e"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "0aec3cba9e9217db1f54c5a74f0923c8"
server_key_iv: "e46f65f4cfb2dcb9d9406a946b8a2caa"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.227120 16310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "edbda51bce9f40e182034d64e3bc850e"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "0aec3cba9e9217db1f54c5a74f0923c8"
server_key_iv: "e46f65f4cfb2dcb9d9406a946b8a2caa"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.230427 16310 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:04.232616 16337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:04.233760 16310 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:21:04.233855 16310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "edbda51bce9f40e182034d64e3bc850e"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "0aec3cba9e9217db1f54c5a74f0923c8"
server_key_iv: "e46f65f4cfb2dcb9d9406a946b8a2caa"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.233946 16310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:04.249607 16310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:04.252642 16310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:04.252801 16310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:04.254101 16310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:04.254155 16310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:04.254196 16310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:04.254225 16310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:04.263957 16310 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:39833
I20260812 11:21:04.264165 16561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:39833 every 8 connection(s)
I20260812 11:21:04.264830 16310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:04.267187 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16310
I20260812 11:21:04.267305 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:04.267546 12991 external_mini_cluster.cc:1428] Setting key 20c61690b4b83df1357eef8d652309e2
I20260812 11:21:04.267881 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.254812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:46719 (local address 127.12.175.254:38355)
0812 11:21:04.254934 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.254939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.255808 (+ 869us) server_negotiation.cc:407] Connection header received
0812 11:21:04.256913 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.256917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.256980 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.257078 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.258678 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.259580 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.261229 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.261563 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.261647 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.264514 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.264517 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.264519 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.264544 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.265893 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.266393 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.266397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.266399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.266484 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.266788 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.266791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.266793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.266961 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.267067 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.267596 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.267722 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:04.268671 16357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.255200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.12.175.193:46719)
0812 11:21:04.255669 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.255716 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.256650 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.257405 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.257415 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.257868 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.258516 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.258540 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.259701 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.259704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.261106 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.261120 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.261718 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.261723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.261935 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.262515 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.262537 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.264346 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.266007 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.266013 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.266025 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.266299 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.266567 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.266570 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.266572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.266701 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.267083 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.267089 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.267354 (+ 265us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.267536 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.267818 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":107,"threads_started":1}
I20260812 11:21:04.270051 16562 heartbeater.cc:347] Connected to a master server at 127.12.175.254:38355
I20260812 11:21:04.270186 16562 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:04.270622 16562 heartbeater.cc:511] Master 127.12.175.254:38355 requested a full tablet report, sending...
I20260812 11:21:04.272007 16176 ts_manager.cc:194] Registered new tserver with Master: edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833)
I20260812 11:21:04.273447 16176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:46719
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:04.278891 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.272253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:60993 (local address 127.12.175.254:38355)
0812 11:21:04.272376 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.272380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.272679 (+ 299us) server_negotiation.cc:407] Connection header received
0812 11:21:04.272773 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.272776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.272814 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.272876 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.273261 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.273799 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.274787 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.275095 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.275168 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.276276 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.276280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.276282 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.276306 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.277468 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.277836 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.277839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.277841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.277913 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.278165 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.278169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.278170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.278329 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.278410 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.278658 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.278758 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:21:04.278926 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.272369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.12.175.193:60993)
0812 11:21:04.272601 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.272613 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.272698 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.272902 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.272905 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.273069 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.273159 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.273165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.273919 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.273921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.274651 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.274662 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.275333 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.275336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.275420 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.275860 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.275871 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.276151 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.277569 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.277573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.277575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.277752 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.277994 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.277997 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.277999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.278082 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.278418 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.278421 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.278511 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.278594 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.278716 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":85,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:04.294409 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38355
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:04.399698 16575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:04.399905 16575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:04.399974 16575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:04.403802 16575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:04.403851 16575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:04.403904 16575 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:21:04.403930 16575 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:04.403990 16575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:04.408802 16575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:04.409633 16575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:04.410497 16575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:04.419163 16587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:04.419220 16575 server_base.cc:1034] running on GCE node
W20260812 11:21:04.419176 16583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:04.419175 16589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:04.419710 16575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:04.420269 16575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:04.421432 16575 hybrid_clock.cc:648] HybridClock initialized: now 1786533664421419 us; error 30 us; skew 500 ppm
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:04.423897 16575 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:04.424639 16575 webserver.cc:460] Webserver started at http://127.12.175.194:35865/ using document root <none> and password file <none>
I20260812 11:21:04.425099 16575 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:04.425153 16575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:04.425304 16575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:04.427075 16575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "f65aa5be87fe35f5a9f297289a125f82"
server_key_iv: "68f4be3fc4c77eeeaa7db8f470679aa2"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.427588 16575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "f65aa5be87fe35f5a9f297289a125f82"
server_key_iv: "68f4be3fc4c77eeeaa7db8f470679aa2"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.430958 16575 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:04.433264 16599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:04.434491 16575 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:04.434580 16575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "f65aa5be87fe35f5a9f297289a125f82"
server_key_iv: "68f4be3fc4c77eeeaa7db8f470679aa2"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.434659 16575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:04.451380 16575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:04.453963 16575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:04.454114 16575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:04.455389 16575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:04.455437 16575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:04.455475 16575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:04.455500 16575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:04.465234 16575 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:42897
I20260812 11:21:04.465322 16814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:42897 every 8 connection(s)
I20260812 11:21:04.466127 16575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:04.468251 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.456103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:56923 (local address 127.12.175.254:38355)
0812 11:21:04.456245 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.456250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.457062 (+ 812us) server_negotiation.cc:407] Connection header received
0812 11:21:04.458126 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.458130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.458189 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.458244 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.459745 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.460451 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.461695 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.462047 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.462157 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.464817 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.464821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.464824 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.464849 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.466196 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.466780 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.466784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.466786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.466879 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.467202 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.467206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.467208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.467430 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.467522 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.467968 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.468090 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:21:04.468919 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.456453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.12.175.194:56923)
0812 11:21:04.456891 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.456939 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.457869 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.458637 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.458646 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.459014 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.459602 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.459617 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.460573 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.460577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.461582 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.461593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.462210 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.462216 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.462442 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.462920 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.462940 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.464665 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.466297 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.466302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.466315 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.466657 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.466976 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.466980 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.466982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.467111 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.467531 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.467537 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.467749 (+ 212us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.467915 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.468201 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":108,"threads_started":1}
I20260812 11:21:04.469667 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16575
I20260812 11:21:04.469766 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:04.470079 12991 external_mini_cluster.cc:1428] Setting key dc708f94add41fdf83d8bd02b03875a8
I20260812 11:21:04.470089 16815 heartbeater.cc:347] Connected to a master server at 127.12.175.254:38355
I20260812 11:21:04.470221 16815 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:04.470723 16815 heartbeater.cc:511] Master 127.12.175.254:38355 requested a full tablet report, sending...
I20260812 11:21:04.471776 16180 ts_manager.cc:194] Registered new tserver with Master: 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897)
I20260812 11:21:04.472478 16180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:56923
I20260812 11:21:04.479070 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.472205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:46545 (local address 127.12.175.254:38355)
0812 11:21:04.472301 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.472305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.472531 (+ 226us) server_negotiation.cc:407] Connection header received
0812 11:21:04.472681 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.472684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.472722 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.472764 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.473302 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.474016 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.475088 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.475324 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.475410 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.476422 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.476425 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.476427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.476447 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.477615 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.478059 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.478061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.478063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.478126 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.478371 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.478373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.478374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.478564 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.478638 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.478883 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.478967 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:04.479164 16829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.472148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.12.175.194:46545)
0812 11:21:04.472444 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.472458 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.472592 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.472885 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.472888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.473070 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.473182 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.473189 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.474171 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.474175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.474964 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.474987 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.475445 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.475448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.475543 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.475906 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.475919 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.476293 (+ 374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.477721 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.477725 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.477727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.477966 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.478199 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.478202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.478204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.478296 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.478652 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.478655 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.478747 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.478851 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.478995 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:04.496220 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38355
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:04.602037 16835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:04.602240 16835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:04.602281 16835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:04.606073 16835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:04.606122 16835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:04.606158 16835 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:21:04.606174 16835 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:04.606204 16835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:04.611063 16835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:04.611992 16835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:04.612859 16835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:04.621407 16843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:04.621462 16849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:04.621417 16845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:04.621574 16835 server_base.cc:1034] running on GCE node
I20260812 11:21:04.621990 16835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:04.622542 16835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:04.623693 16835 hybrid_clock.cc:648] HybridClock initialized: now 1786533664623678 us; error 29 us; skew 500 ppm
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:04.626111 16835 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:04.626842 16835 webserver.cc:460] Webserver started at http://127.12.175.195:44627/ using document root <none> and password file <none>
I20260812 11:21:04.627359 16835 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:04.627426 16835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:04.627607 16835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:04.629406 16835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "8c75cbe935754b21acc6d07643dc3e50"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "da2abed36e318dceec474a43fcdd25fc"
server_key_iv: "29bc4129e15472b3513c9a79f93c3be4"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.629920 16835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "8c75cbe935754b21acc6d07643dc3e50"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "da2abed36e318dceec474a43fcdd25fc"
server_key_iv: "29bc4129e15472b3513c9a79f93c3be4"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.633329 16835 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 11:21:04.635532 16865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:04.636586 16835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:04.636687 16835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "8c75cbe935754b21acc6d07643dc3e50"
format_stamp: "Formatted at 2026-08-12 11:21:04 on dist-test-slave-gjrz"
server_key: "da2abed36e318dceec474a43fcdd25fc"
server_key_iv: "29bc4129e15472b3513c9a79f93c3be4"
server_key_version: "encryptionkey@0"
I20260812 11:21:04.636773 16835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:04.651322 16835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:04.653837 16835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:04.654006 16835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:04.655293 16835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:04.655339 16835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:04.655388 16835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:04.655417 16835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:04.665401 16835 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:40087
I20260812 11:21:04.665673 17076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:40087 every 8 connection(s)
I20260812 11:21:04.666215 16835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:04.668020 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.656006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:43459 (local address 127.12.175.254:38355)
0812 11:21:04.656148 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.656152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.656908 (+ 756us) server_negotiation.cc:407] Connection header received
0812 11:21:04.657815 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.657818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.657876 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.657933 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.659489 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.660076 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.661354 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.661641 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.661738 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.664584 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.664587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.664589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.664614 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.666109 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.666657 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.666660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.666662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.666754 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.667138 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.667140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.667142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.667356 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.667438 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.667813 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.667903 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:21:04.668725 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.656336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.12.175.195:43459)
0812 11:21:04.656750 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.656795 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.657591 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.658323 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.658332 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.658766 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.659348 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.659366 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.660196 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.660200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.661240 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.661250 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.661792 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.661796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.661967 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.662460 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.662488 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.664403 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.666219 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.666225 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.666238 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.666553 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.666867 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.666871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.666873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.667043 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.667436 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.667440 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.667631 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.667775 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.667997 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":93,"threads_started":1}
I20260812 11:21:04.669889 17077 heartbeater.cc:347] Connected to a master server at 127.12.175.254:38355
I20260812 11:21:04.670025 17077 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:04.670536 17077 heartbeater.cc:511] Master 127.12.175.254:38355 requested a full tablet report, sending...
I20260812 11:21:04.671168 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16835
I20260812 11:21:04.671296 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:04.671589 12991 external_mini_cluster.cc:1428] Setting key f00094f9441ba7e4c66d6069d6f70fd6
I20260812 11:21:04.671633 16176 ts_manager.cc:194] Registered new tserver with Master: 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087)
I20260812 11:21:04.672310 16176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:43459
I20260812 11:21:04.673604 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:21:04.679013 17088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.671840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.12.175.195:54395)
0812 11:21:04.672104 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.672118 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.672193 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.673392 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.673395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.673557 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.673645 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.673651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.674383 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.674386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.674919 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.674926 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.675350 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.675353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.675440 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.675848 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.675862 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.676225 (+ 363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.677801 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.677803 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.677805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.677972 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.678231 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.678233 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.678234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.678298 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.678646 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.678648 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.678715 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.678782 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.678873 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":87,"threads_started":1}
I20260812 11:21:04.679131 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.672549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:54395 (local address 127.12.175.254:38355)
0812 11:21:04.672646 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.672650 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.672661 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:04.672694 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.672697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.672735 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.672802 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.673786 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.674260 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.675022 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.675227 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.675326 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.676351 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.676354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.676356 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.676377 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.677691 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.678055 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.678058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.678060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.678140 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.678367 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.678369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.678371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.678561 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.678662 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.678862 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.678966 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:04.698621 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.691934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.12.175.254:38355)
0812 11:21:04.692053 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.692056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.692067 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:04.692095 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.692097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.692128 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.692188 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.692753 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.693221 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.694037 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.694228 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.694292 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.696438 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.696441 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.696442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.696461 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.697460 (+ 999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.697801 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.697803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.697804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.697861 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.698037 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.698039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.698040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.698176 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.698265 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.698423 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.698500 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:21:04.701121 16176 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:04.703953 16176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:04.716941 17107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.711472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42897 (local address 127.0.0.1:47248)
0812 11:21:04.711701 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.711738 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.711829 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.713235 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.713237 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.713254 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.713331 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.713337 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.714237 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.714241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.715648 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.715660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.716436 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.716440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.716556 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.716592 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.716688 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.716792 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":27,"thread_start_us":79,"threads_started":1}
I20260812 11:21:04.717075 17108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.711844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39833 (local address 127.0.0.1:40696)
0812 11:21:04.712048 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.712060 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.712139 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.712913 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.712918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.712941 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.713047 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.713053 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.714504 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.714507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.715649 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.715659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.716698 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.716702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.716791 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.716811 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.716868 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.716924 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":54,"thread_start_us":88,"threads_started":1}
I20260812 11:21:04.717116 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.712046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40696 (local address 127.12.175.193:39833)
0812 11:21:04.712468 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.712479 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.712501 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:21:04.712573 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.712577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.712761 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.712914 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.713163 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.714354 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.715763 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.716570 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.716725 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.716842 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.716895 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.716979 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":100,"threads_started":1}
I20260812 11:21:04.717288 17103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.711174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40087 (local address 127.0.0.1:54192)
0812 11:21:04.711678 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.711722 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.711827 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.713062 (+ 1235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.713065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.713081 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.713174 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.713181 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.714466 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.714470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.715679 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.715686 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.716910 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.716914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.717002 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.717026 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.717107 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.717173 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":62,"thread_start_us":91,"threads_started":1}
I20260812 11:21:04.717646 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.712266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47248 (local address 127.12.175.194:42897)
0812 11:21:04.712811 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.712820 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.712838 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:21:04.712911 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.712917 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.713124 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.713252 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.713415 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.714133 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.715792 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.716323 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.716449 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.716591 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.717424 (+ 833us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.717516 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":101,"threads_started":1}
I20260812 11:21:04.717813 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.711238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54192 (local address 127.12.175.195:40087)
0812 11:21:04.712467 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.712479 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.712501 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:21:04.712567 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.712572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.712761 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.712914 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.713300 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.714362 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.715791 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.716547 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.716726 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.716842 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.717612 (+ 770us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.717684 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1139,"thread_start_us":117,"threads_started":1}
I20260812 11:21:04.719791 16425 tablet_service.cc:1467] Processing CreateTablet for tablet 3d6f6af908c44969850c8772eccecdec (DEFAULT_TABLE table=test-table [id=fae32c34b1894e0ab3c75f46da9746e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:04.720690 16425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d6f6af908c44969850c8772eccecdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.720388 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 3d6f6af908c44969850c8772eccecdec (DEFAULT_TABLE table=test-table [id=fae32c34b1894e0ab3c75f46da9746e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:04.720389 16691 tablet_service.cc:1467] Processing CreateTablet for tablet 3d6f6af908c44969850c8772eccecdec (DEFAULT_TABLE table=test-table [id=fae32c34b1894e0ab3c75f46da9746e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:04.721352 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d6f6af908c44969850c8772eccecdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.721360 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d6f6af908c44969850c8772eccecdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.727420 17114 tablet_bootstrap.cc:492] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Bootstrap starting.
I20260812 11:21:04.728574 17120 tablet_bootstrap.cc:492] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Bootstrap starting.
I20260812 11:21:04.729445 17116 tablet_bootstrap.cc:492] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Bootstrap starting.
I20260812 11:21:04.729807 17114 tablet_bootstrap.cc:654] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.730611 17120 tablet_bootstrap.cc:654] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.730697 17114 log.cc:824] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:04.731093 17116 tablet_bootstrap.cc:654] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.731899 17116 log.cc:824] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:04.731912 17120 log.cc:824] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:04.734119 17116 tablet_bootstrap.cc:492] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: No bootstrap required, opened a new log
I20260812 11:21:04.734270 17120 tablet_bootstrap.cc:492] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: No bootstrap required, opened a new log
I20260812 11:21:04.734395 17116 ts_tablet_manager.cc:1397] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260812 11:21:04.734453 17120 ts_tablet_manager.cc:1397] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:21:04.734833 17114 tablet_bootstrap.cc:492] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: No bootstrap required, opened a new log
I20260812 11:21:04.735003 17114 ts_tablet_manager.cc:1397] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 11:21:04.737385 17116 raft_consensus.cc:348] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.737612 17116 raft_consensus.cc:374] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.737665 17116 raft_consensus.cc:729] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d2ffe2c970439ab7c7333d3dbc62c7, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.738062 17116 consensus_queue.cc:260] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.738350 17120 raft_consensus.cc:348] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.738590 17120 raft_consensus.cc:374] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.738648 17120 raft_consensus.cc:729] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.738612 17114 raft_consensus.cc:348] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.738839 17114 raft_consensus.cc:374] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.738886 17114 raft_consensus.cc:729] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.738940 17116 ts_tablet_manager.cc:1428] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 11:21:04.739089 17120 consensus_queue.cc:260] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.739295 16815 heartbeater.cc:503] Master 127.12.175.254:38355 was elected leader, sending a full tablet report...
I20260812 11:21:04.739244 17114 consensus_queue.cc:260] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.740005 17114 ts_tablet_manager.cc:1428] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260812 11:21:04.740027 17120 ts_tablet_manager.cc:1428] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:21:04.740341 17077 heartbeater.cc:503] Master 127.12.175.254:38355 was elected leader, sending a full tablet report...
I20260812 11:21:04.741171 16562 heartbeater.cc:503] Master 127.12.175.254:38355 was elected leader, sending a full tablet report...
I20260812 11:21:04.746691 17129 raft_consensus.cc:482] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:04.746812 17129 raft_consensus.cc:504] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.747921 17129 leader_election.cc:288] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897), edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833)
I20260812 11:21:04.751092 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.748113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:59843 (local address 127.12.175.194:42897)
0812 11:21:04.748232 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.748237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.748252 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:21:04.748370 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.748373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.748419 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.748495 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.748718 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.749211 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.750185 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.750597 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.750696 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.750747 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.750915 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.750984 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:21:04.751092 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.748083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42897 (local address 127.12.175.195:59843)
0812 11:21:04.748188 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.748202 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.748273 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.748508 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.748511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.748531 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.748634 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.748639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.749313 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.749317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.750071 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.750080 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.750696 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.750700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.750810 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.750830 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.750894 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.750968 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 11:21:04.751628 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6f6af908c44969850c8772eccecdec" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" is_pre_election: true
I20260812 11:21:04.751852 16733 raft_consensus.cc:2454] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 0.
I20260812 11:21:04.752012 17124 raft_consensus.cc:482] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:04.752148 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.748405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:35511 (local address 127.12.175.193:39833)
0812 11:21:04.748519 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.748523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.748866 (+ 343us) server_negotiation.cc:407] Connection header received
0812 11:21:04.748949 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.748951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.748990 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.749050 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.749284 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.749754 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.751115 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.751647 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.751752 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.751960 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.751995 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.752054 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:04.752168 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.748315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39833 (local address 127.12.175.195:35511)
0812 11:21:04.748797 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.748806 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.748876 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.749065 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.749067 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.749082 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.749193 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.749198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.749849 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.749852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.751004 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.751014 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.751774 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.751778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.751872 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.751894 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.751956 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.752029 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":115,"threads_started":1}
I20260812 11:21:04.752276 16872 leader_election.cc:302] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, 8c75cbe935754b21acc6d07643dc3e50; no voters:
I20260812 11:21:04.752415 17124 raft_consensus.cc:504] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.752578 17129 raft_consensus.cc:2781] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:04.752660 17129 raft_consensus.cc:482] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:04.752703 17129 raft_consensus.cc:3037] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.752923 16469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6f6af908c44969850c8772eccecdec" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e" is_pre_election: true
I20260812 11:21:04.753139 16469 raft_consensus.cc:2454] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 0.
I20260812 11:21:04.753842 17124 leader_election.cc:288] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087), edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833)
I20260812 11:21:04.753883 17129 raft_consensus.cc:504] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.754140 17129 leader_election.cc:288] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 election: Requested vote from peers 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897), edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833)
I20260812 11:21:04.754637 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6f6af908c44969850c8772eccecdec" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
I20260812 11:21:04.754660 16469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6f6af908c44969850c8772eccecdec" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e"
I20260812 11:21:04.754755 16733 raft_consensus.cc:3037] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.754762 16469 raft_consensus.cc:3037] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.756013 16469 raft_consensus.cc:2454] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 1.
I20260812 11:21:04.756152 16733 raft_consensus.cc:2454] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 1.
I20260812 11:21:04.756318 16872 leader_election.cc:302] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c75cbe935754b21acc6d07643dc3e50, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:04.756635 17129 raft_consensus.cc:2781] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:04.756817 17129 raft_consensus.cc:686] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 1 LEADER]: Becoming Leader. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Running, Role: LEADER
I20260812 11:21:04.757110 17129 consensus_queue.cc:237] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } }
I20260812 11:21:04.757491 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.753387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39833 (local address 127.12.175.194:49915)
0812 11:21:04.753522 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.753534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.753605 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.754158 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.754160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.754178 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.754274 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.754280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.755167 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.755170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.756311 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.756322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.757127 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.757131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.757240 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.757266 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.757317 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.757382 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 11:21:04.757895 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.753603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:49915 (local address 127.12.175.193:39833)
0812 11:21:04.753983 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.753986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.753996 (+ 10us) server_negotiation.cc:407] Connection header received
0812 11:21:04.754028 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.754030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.754061 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.754122 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.754399 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.755025 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.756455 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.756979 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.757669 (+ 690us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.757709 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.757744 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.757800 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322}
I20260812 11:21:04.758510 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.753720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:41401 (local address 127.12.175.195:40087)
0812 11:21:04.753839 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.753843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.754405 (+ 562us) server_negotiation.cc:407] Connection header received
0812 11:21:04.754498 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.754501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.754539 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.754607 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:04.755511 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.756180 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.757520 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.758038 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.758141 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.758183 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.758352 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.758412 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:21:04.758533 17136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.753387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40087 (local address 127.12.175.194:41401)
0812 11:21:04.754330 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.754342 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.754429 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.754696 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.754699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.754774 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:04.755380 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.755391 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.756371 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.756374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.757409 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.757419 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.758151 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.758154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.758247 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.758268 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.758331 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.758394 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":884,"mutex_wait_us":255,"thread_start_us":82,"threads_started":1}
I20260812 11:21:04.759133 16995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6f6af908c44969850c8772eccecdec" candidate_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c75cbe935754b21acc6d07643dc3e50" is_pre_election: true
I20260812 11:21:04.759938 16469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6f6af908c44969850c8772eccecdec" candidate_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e" is_pre_election: true
I20260812 11:21:04.760092 16469 raft_consensus.cc:2379] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85d2ffe2c970439ab7c7333d3dbc62c7 in current term 1: Already voted for candidate 8c75cbe935754b21acc6d07643dc3e50 in this term.
I20260812 11:21:04.760473 16603 leader_election.cc:302] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7; no voters: 8c75cbe935754b21acc6d07643dc3e50, edbda51bce9f40e182034d64e3bc850e
I20260812 11:21:04.760696 17124 raft_consensus.cc:2726] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 11:21:04.760485 16180 catalog_manager.cc:5495] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } health_report { overall_health: UNKNOWN } } }
W20260812 11:21:04.766458 16565 tablet.cc:2369] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 11:21:04 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533663, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:04.811921 17149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.804645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38355 (local address 127.0.0.1:60898)
0812 11:21:04.804910 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.804920 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.805018 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.805223 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.805226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.805602 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:04.805692 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.805699 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.806402 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.806405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.806947 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.806955 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.807378 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.807381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.807483 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.807946 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:04.807957 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:04.809215 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:04.810484 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.810493 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.810499 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.810709 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.810949 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:04.810952 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:04.810954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:04.811024 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:04.811372 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:04.811379 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:04.811484 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.811584 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.811738 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":3,"thread_start_us":104,"threads_started":1}
I20260812 11:21:04.811920 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.804711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60898 (local address 127.12.175.254:38355)
0812 11:21:04.804835 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.804839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.804983 (+ 144us) server_negotiation.cc:407] Connection header received
0812 11:21:04.805092 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.805095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.805133 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.805194 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:04.805799 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.806307 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.807054 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.807282 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.807374 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.809332 (+ 1958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:04.809336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:04.809338 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:04.809357 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:04.810389 (+ 1032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.810796 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.810799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.810801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.810869 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:04.811100 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:04.811103 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:04.811105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:04.811284 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:04.811372 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.811647 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.811787 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":44}
I20260812 11:21:04.815284 16180 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:60898:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:21:04.815963 16180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:04.820602 16955 tablet_service.cc:1467] Processing CreateTablet for tablet be9939adb6b64343bb36aefc445afc4a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bdaf33d7f3f54718b35383f0ae4d4043]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:04.820461 16425 tablet_service.cc:1467] Processing CreateTablet for tablet be9939adb6b64343bb36aefc445afc4a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bdaf33d7f3f54718b35383f0ae4d4043]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:04.820524 16691 tablet_service.cc:1467] Processing CreateTablet for tablet be9939adb6b64343bb36aefc445afc4a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bdaf33d7f3f54718b35383f0ae4d4043]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:04.821175 16425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be9939adb6b64343bb36aefc445afc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.821175 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be9939adb6b64343bb36aefc445afc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.821189 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be9939adb6b64343bb36aefc445afc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.823616 17116 tablet_bootstrap.cc:492] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: Bootstrap starting.
I20260812 11:21:04.823946 17114 tablet_bootstrap.cc:492] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: Bootstrap starting.
I20260812 11:21:04.823937 17120 tablet_bootstrap.cc:492] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: Bootstrap starting.
I20260812 11:21:04.824483 17116 tablet_bootstrap.cc:654] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.824868 17114 tablet_bootstrap.cc:654] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.824908 17120 tablet_bootstrap.cc:654] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.826110 17114 tablet_bootstrap.cc:492] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: No bootstrap required, opened a new log
I20260812 11:21:04.826198 17120 tablet_bootstrap.cc:492] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: No bootstrap required, opened a new log
I20260812 11:21:04.826197 17114 ts_tablet_manager.cc:1397] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 11:21:04.826274 17120 ts_tablet_manager.cc:1397] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:04.826645 17114 raft_consensus.cc:348] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.826673 17120 raft_consensus.cc:348] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.826763 17120 raft_consensus.cc:374] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.826763 17114 raft_consensus.cc:374] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.826802 17120 raft_consensus.cc:729] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.826802 17114 raft_consensus.cc:729] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.826927 17120 consensus_queue.cc:260] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.826941 17114 consensus_queue.cc:260] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.827193 17114 ts_tablet_manager.cc:1428] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:04.827174 17129 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.827337 17129 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.827193 17120 ts_tablet_manager.cc:1428] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:21:04.827705 17130 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.827848 17130 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.828089 17116 tablet_bootstrap.cc:492] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: No bootstrap required, opened a new log
I20260812 11:21:04.828166 17116 ts_tablet_manager.cc:1397] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260812 11:21:04.828536 17116 raft_consensus.cc:348] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.828657 17116 raft_consensus.cc:374] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.828701 17116 raft_consensus.cc:729] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d2ffe2c970439ab7c7333d3dbc62c7, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.828826 17116 consensus_queue.cc:260] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.829073 17116 ts_tablet_manager.cc:1428] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260812 11:21:04.829154 17124 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.829293 17124 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.846719 17129 raft_consensus.cc:482] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:04.846808 17129 raft_consensus.cc:504] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.847112 17129 leader_election.cc:288] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833), 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897)
I20260812 11:21:04.847471 16469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be9939adb6b64343bb36aefc445afc4a" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e" is_pre_election: true
I20260812 11:21:04.847514 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be9939adb6b64343bb36aefc445afc4a" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" is_pre_election: true
I20260812 11:21:04.847611 16469 raft_consensus.cc:2454] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 0.
I20260812 11:21:04.847620 16733 raft_consensus.cc:2454] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 0.
I20260812 11:21:04.847865 16872 leader_election.cc:302] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c75cbe935754b21acc6d07643dc3e50, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:04.848021 17129 raft_consensus.cc:2781] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:04.848089 17129 raft_consensus.cc:482] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:04.848115 17129 raft_consensus.cc:3037] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.848902 17129 raft_consensus.cc:504] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.849195 17129 leader_election.cc:288] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 election: Requested vote from peers edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833), 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897)
I20260812 11:21:04.849501 16469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be9939adb6b64343bb36aefc445afc4a" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e"
I20260812 11:21:04.849568 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be9939adb6b64343bb36aefc445afc4a" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
I20260812 11:21:04.849619 16469 raft_consensus.cc:3037] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.849669 16733 raft_consensus.cc:3037] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:04.850656 16733 raft_consensus.cc:2454] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 1.
I20260812 11:21:04.850656 16469 raft_consensus.cc:2454] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 1.
I20260812 11:21:04.850900 16872 leader_election.cc:302] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c75cbe935754b21acc6d07643dc3e50, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:04.851152 17129 raft_consensus.cc:2781] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:04.851239 17129 raft_consensus.cc:686] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [term 1 LEADER]: Becoming Leader. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Running, Role: LEADER
I20260812 11:21:04.851385 17129 consensus_queue.cc:237] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.851969 17137 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: TxnStatusTablet state changed. Reason: New leader 8c75cbe935754b21acc6d07643dc3e50. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.852061 17137 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:04.852366 17158 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:21:04.852584 17158 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:21:04.852799 16172 catalog_manager.cc:5495] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } health_report { overall_health: HEALTHY } } }
I20260812 11:21:04.867095 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.863862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54208 (local address 127.12.175.195:40087)
0812 11:21:04.863993 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.863997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.864011 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:04.864137 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.864140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.864191 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.864265 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:04.864495 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.864988 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.865790 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.866001 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.866086 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.866366 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:04.866741 (+ 375us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:04.866838 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.866922 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.866972 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:21:04.867112 17149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.863758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40087 (local address 127.0.0.1:54208)
0812 11:21:04.863886 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.863901 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.864011 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.864288 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.864291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.864298 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:04.864397 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.864403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.865088 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.865092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.865681 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.865688 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.866095 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.866098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.866191 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.866234 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:04.866831 (+ 597us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:04.866847 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.866912 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.866994 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 11:21:04.871932 16469 raft_consensus.cc:1261] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Refusing update from remote peer 8c75cbe935754b21acc6d07643dc3e50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:04.871973 16733 raft_consensus.cc:1261] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Refusing update from remote peer 8c75cbe935754b21acc6d07643dc3e50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:04.872484 17129 consensus_queue.cc:1035] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:04.872648 17137 consensus_queue.cc:1035] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:04.876035 17124 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: TxnStatusTablet state changed. Reason: New leader 8c75cbe935754b21acc6d07643dc3e50. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.876151 17124 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.876962 17130 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: TxnStatusTablet state changed. Reason: New leader 8c75cbe935754b21acc6d07643dc3e50. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.877075 17130 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.878419 17129 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.878518 17129 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:04.879487 17165 mvcc.cc:205] Tried to move back new op lower bound from 7317641891309621248 to 7317641891232436224. Current Snapshot: MvccSnapshot[applied={T|T < 7317641891309621248}]
I20260812 11:21:04.879618 17130 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.879696 17130 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P edbda51bce9f40e182034d64e3bc850e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.884778 17137 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.884888 17137 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 8c75cbe935754b21acc6d07643dc3e50: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:04.886091 17124 tablet_replica.cc:439] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } } }
I20260812 11:21:04.886196 17124 tablet_replica.cc:442] T be9939adb6b64343bb36aefc445afc4a P 85d2ffe2c970439ab7c7333d3dbc62c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:04.893507 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.890253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.12.175.195:40087)
0812 11:21:04.890359 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.890363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.890378 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:21:04.890485 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.890488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.890532 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.890610 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:04.890884 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.891641 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.892449 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.892795 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.892902 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.893128 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:04.893204 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:04.893271 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.893337 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.893383 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:04.902756 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.900132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:35337 (local address 127.12.175.195:40087)
0812 11:21:04.900226 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:04.900230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:04.900242 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:04.900303 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:04.900305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:04.900341 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:04.900395 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:04.900606 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.901051 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.901825 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.902029 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.902112 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.902375 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:04.902435 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:04.902491 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:04.902586 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 11:21:04.902624 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:04.902756 17088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:04.900018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40087 (local address 127.12.175.195:35337)
0812 11:21:04.900140 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:04.900154 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:04.900232 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:04.900418 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:04.900421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:04.900427 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:04.900513 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.900518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.901153 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.901156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.901725 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:04.901732 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:04.902127 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:04.902130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:04.902206 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:04.902243 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:04.902510 (+ 267us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:04.902515 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:21:04.902571 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 11:21:04.902639 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 11:21:04.908883 16733 raft_consensus.cc:1261] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Refusing update from remote peer 8c75cbe935754b21acc6d07643dc3e50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:04.908901 16469 raft_consensus.cc:1261] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Refusing update from remote peer 8c75cbe935754b21acc6d07643dc3e50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:04.909241 17175 consensus_queue.cc:1035] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:04.909374 17137 consensus_queue.cc:1035] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:04.912395 17161 mvcc.cc:205] Tried to move back new op lower bound from 7317641891463806976 to 7317641890848133120. Current Snapshot: MvccSnapshot[applied={T|T < 7317641891463806976}]
I20260812 11:21:04.925899 17162 mvcc.cc:205] Tried to move back new op lower bound from 7317641891463806976 to 7317641890848133120. Current Snapshot: MvccSnapshot[applied={T|T < 7317641891463806976}]
I20260812 11:21:04.947916 16174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:04.948061 16174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:04.950177 16174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Sending DeleteTablet for 3 replicas of tablet 3d6f6af908c44969850c8772eccecdec
I20260812 11:21:04.950775 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d6f6af908c44969850c8772eccecdec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:04 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:54192
I20260812 11:21:04.950933 16425 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d6f6af908c44969850c8772eccecdec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:04 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:40696
I20260812 11:21:04.951491 17189 tablet_replica.cc:330] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: stopping tablet replica
I20260812 11:21:04.951473 16691 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d6f6af908c44969850c8772eccecdec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:04 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:47248
I20260812 11:21:04.951515 16174 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:21:04.951773 17189 raft_consensus.cc:2229] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 11:21:04.951876 16174 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:04.951965 17189 raft_consensus.cc:2258] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:04.952287 17185 tablet_replica.cc:330] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: stopping tablet replica
I20260812 11:21:04.952617 17185 raft_consensus.cc:2229] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:04.953154 17185 raft_consensus.cc:2258] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:04.953258 17189 ts_tablet_manager.cc:1905] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:04.954537 17185 ts_tablet_manager.cc:1905] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:04.956295 17189 ts_tablet_manager.cc:1918] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:04.956390 17189 log.cc:1196] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/3d6f6af908c44969850c8772eccecdec
I20260812 11:21:04.956645 16425 tablet_service.cc:1467] Processing CreateTablet for tablet eb7bcbf3af0e48ea8957401980bdaeeb (DEFAULT_TABLE table=test-table [id=bb31fc0ab0f7437c9231da69f6cf9e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:04.956642 16955 tablet_service.cc:1467] Processing CreateTablet for tablet eb7bcbf3af0e48ea8957401980bdaeeb (DEFAULT_TABLE table=test-table [id=bb31fc0ab0f7437c9231da69f6cf9e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:04.956732 17189 ts_tablet_manager.cc:1939] T 3d6f6af908c44969850c8772eccecdec P edbda51bce9f40e182034d64e3bc850e: Deleting consensus metadata
I20260812 11:21:04.956873 16425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7bcbf3af0e48ea8957401980bdaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.956892 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7bcbf3af0e48ea8957401980bdaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.958653 17114 tablet_bootstrap.cc:492] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Bootstrap starting.
I20260812 11:21:04.958833 16691 tablet_service.cc:1467] Processing CreateTablet for tablet eb7bcbf3af0e48ea8957401980bdaeeb (DEFAULT_TABLE table=test-table [id=bb31fc0ab0f7437c9231da69f6cf9e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:04.959087 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7bcbf3af0e48ea8957401980bdaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:04.959527 17191 tablet_replica.cc:330] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: stopping tablet replica
I20260812 11:21:04.959561 17114 tablet_bootstrap.cc:654] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.959702 16156 catalog_manager.cc:4841] TS edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833): tablet 3d6f6af908c44969850c8772eccecdec (table test-table [id=fae32c34b1894e0ab3c75f46da9746e2]) successfully deleted
I20260812 11:21:04.959795 17191 raft_consensus.cc:2229] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:04.959977 17191 raft_consensus.cc:2258] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:04.960142 17120 tablet_bootstrap.cc:492] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Bootstrap starting.
I20260812 11:21:04.960897 17120 tablet_bootstrap.cc:654] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.961308 17191 ts_tablet_manager.cc:1905] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:04.962270 17116 tablet_bootstrap.cc:492] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Bootstrap starting.
I20260812 11:21:04.963127 17116 tablet_bootstrap.cc:654] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:04.963209 17120 tablet_bootstrap.cc:492] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: No bootstrap required, opened a new log
I20260812 11:21:04.963325 17120 ts_tablet_manager.cc:1397] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:04.963770 17120 raft_consensus.cc:348] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.963878 17120 raft_consensus.cc:374] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.963912 17120 raft_consensus.cc:729] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.963989 17191 ts_tablet_manager.cc:1918] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:04.964020 17120 consensus_queue.cc:260] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.964088 17191 log.cc:1196] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/3d6f6af908c44969850c8772eccecdec
I20260812 11:21:04.964303 17120 ts_tablet_manager.cc:1428] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:04.964988 17191 ts_tablet_manager.cc:1939] T 3d6f6af908c44969850c8772eccecdec P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting consensus metadata
I20260812 11:21:04.965639 17114 tablet_bootstrap.cc:492] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: No bootstrap required, opened a new log
I20260812 11:21:04.965723 17114 ts_tablet_manager.cc:1397] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260812 11:21:04.966070 16156 catalog_manager.cc:4841] TS 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897): tablet 3d6f6af908c44969850c8772eccecdec (table test-table [id=fae32c34b1894e0ab3c75f46da9746e2]) successfully deleted
I20260812 11:21:04.966112 17114 raft_consensus.cc:348] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.966215 17114 raft_consensus.cc:374] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.966255 17114 raft_consensus.cc:729] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.966368 17114 consensus_queue.cc:260] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.966645 17114 ts_tablet_manager.cc:1428] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260812 11:21:04.967429 17185 ts_tablet_manager.cc:1918] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:04.967571 17185 log.cc:1196] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/3d6f6af908c44969850c8772eccecdec
I20260812 11:21:04.967968 17185 ts_tablet_manager.cc:1939] T 3d6f6af908c44969850c8772eccecdec P 8c75cbe935754b21acc6d07643dc3e50: Deleting consensus metadata
I20260812 11:21:04.969106 16157 catalog_manager.cc:4841] TS 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087): tablet 3d6f6af908c44969850c8772eccecdec (table test-table [id=fae32c34b1894e0ab3c75f46da9746e2]) successfully deleted
I20260812 11:21:04.969555 17116 tablet_bootstrap.cc:492] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: No bootstrap required, opened a new log
I20260812 11:21:04.969630 17116 ts_tablet_manager.cc:1397] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260812 11:21:04.970001 17116 raft_consensus.cc:348] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.970089 17116 raft_consensus.cc:374] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:04.970117 17116 raft_consensus.cc:729] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d2ffe2c970439ab7c7333d3dbc62c7, State: Initialized, Role: FOLLOWER
I20260812 11:21:04.970233 17116 consensus_queue.cc:260] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:04.970715 17116 ts_tablet_manager.cc:1428] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:21:05.140554 17130 raft_consensus.cc:482] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:05.140698 17130 raft_consensus.cc:504] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:05.141815 17130 leader_election.cc:288] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897), 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087)
I20260812 11:21:05.145825 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.142228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:55613 (local address 127.12.175.195:40087)
0812 11:21:05.142358 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:05.142362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:05.142588 (+ 226us) server_negotiation.cc:407] Connection header received
0812 11:21:05.142718 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:05.142721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:05.142767 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:05.142822 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:05.143158 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.143713 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.144885 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.145261 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.145362 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.145436 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:05.145631 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 11:21:05.145698 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:05.145831 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.142377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:47625 (local address 127.12.175.194:42897)
0812 11:21:05.142538 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:05.142542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:05.142623 (+ 81us) server_negotiation.cc:407] Connection header received
0812 11:21:05.142757 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:05.142759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:05.142798 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:05.142870 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:05.143178 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.143719 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.144881 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.145270 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.145378 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.145431 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:05.145656 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 11:21:05.145727 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:21:05.145854 17199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.142112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42897 (local address 127.12.175.193:47625)
0812 11:21:05.142529 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:05.142542 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:05.142653 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:05.142890 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:05.142901 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:05.142918 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:05.143064 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.143069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.143826 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.143829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.144755 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.144766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.145402 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.145406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.145540 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.145558 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:21:05.145630 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:21:05.145696 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":135,"thread_start_us":110,"threads_started":1}
I20260812 11:21:05.145859 17197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.142111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40087 (local address 127.12.175.193:55613)
0812 11:21:05.142460 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:05.142481 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:05.142618 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:05.142850 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:05.142853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:05.142869 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:05.143046 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.143053 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.143817 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.143820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.144757 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.144767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.145387 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.145391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.145494 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.145536 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:21:05.145592 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 11:21:05.145656 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":66,"thread_start_us":66,"threads_started":1}
I20260812 11:21:05.146292 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7bcbf3af0e48ea8957401980bdaeeb" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" is_pre_election: true
I20260812 11:21:05.146426 16733 raft_consensus.cc:2454] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 0.
I20260812 11:21:05.146771 16348 leader_election.cc:302] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:05.146818 16995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7bcbf3af0e48ea8957401980bdaeeb" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c75cbe935754b21acc6d07643dc3e50" is_pre_election: true
I20260812 11:21:05.147014 17130 raft_consensus.cc:2781] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:05.146998 16995 raft_consensus.cc:2454] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 0.
I20260812 11:21:05.147074 17130 raft_consensus.cc:482] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:05.147116 17130 raft_consensus.cc:3037] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:05.148188 17130 raft_consensus.cc:504] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:05.148522 17130 leader_election.cc:288] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 election: Requested vote from peers 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897), 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087)
I20260812 11:21:05.148826 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7bcbf3af0e48ea8957401980bdaeeb" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
I20260812 11:21:05.148844 16995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7bcbf3af0e48ea8957401980bdaeeb" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c75cbe935754b21acc6d07643dc3e50"
I20260812 11:21:05.148938 16733 raft_consensus.cc:3037] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:05.148950 16995 raft_consensus.cc:3037] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:05.149919 16995 raft_consensus.cc:2454] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 1.
I20260812 11:21:05.149958 16733 raft_consensus.cc:2454] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 1.
I20260812 11:21:05.150213 16348 leader_election.cc:302] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:05.150377 17130 raft_consensus.cc:2781] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:05.150597 17130 raft_consensus.cc:686] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 1 LEADER]: Becoming Leader. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Running, Role: LEADER
I20260812 11:21:05.150918 17130 consensus_queue.cc:237] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:05.153062 16172 catalog_manager.cc:5495] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e reported cstate change: term changed from 0 to 1, leader changed from <none> to edbda51bce9f40e182034d64e3bc850e (127.12.175.193). New cstate: current_term: 1 leader_uuid: "edbda51bce9f40e182034d64e3bc850e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } health_report { overall_health: UNKNOWN } } }
W20260812 11:21:05.168316 17078 tablet.cc:2369] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:05.207898 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.204497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.12.175.193:39833)
0812 11:21:05.204604 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:05.204609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:05.204622 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:05.204780 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:05.204782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:05.204837 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:05.204958 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:05.205190 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.205680 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.206475 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.206690 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.206777 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.207033 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:05.207517 (+ 484us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:05.207625 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:05.207702 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 11:21:05.207758 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:05.218031 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.214908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:51657 (local address 127.12.175.195:40087)
0812 11:21:05.215052 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:05.215057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:05.215159 (+ 102us) server_negotiation.cc:407] Connection header received
0812 11:21:05.215308 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:05.215312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:05.215360 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:05.215429 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:05.215662 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.216254 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.217070 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.217289 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.217372 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.217649 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:05.217719 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:05.217775 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:05.217863 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 11:21:05.217908 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:21:05.218070 17208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.214785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40087 (local address 127.12.175.193:51657)
0812 11:21:05.215075 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:05.215089 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:05.215192 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:05.215439 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:05.215442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:05.215449 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:05.215567 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.215572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.216367 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.216370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.216961 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.216969 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.217384 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.217387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.217480 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.217531 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:05.217790 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:05.217797 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:21:05.217855 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 11:21:05.217932 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":105,"threads_started":1}
W20260812 11:21:05.218078 16818 tablet.cc:2369] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:05.223215 16733 raft_consensus.cc:1261] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Refusing update from remote peer edbda51bce9f40e182034d64e3bc850e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:05.223510 16995 raft_consensus.cc:1261] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Refusing update from remote peer edbda51bce9f40e182034d64e3bc850e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:05.223671 17201 consensus_queue.cc:1035] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:05.223938 17130 consensus_queue.cc:1035] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:05.238565 17088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.235555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39833 (local address 127.12.175.195:60745)
0812 11:21:05.235659 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:05.235673 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:05.235738 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:05.235942 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:05.235945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:05.235953 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:05.236046 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.236052 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.236941 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.236944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.237513 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:05.237521 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.237979 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.237982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:05.238043 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.238069 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:05.238316 (+ 247us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:05.238323 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:21:05.238380 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:21:05.238457 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 11:21:05.238564 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:05.235605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:60745 (local address 127.12.175.193:39833)
0812 11:21:05.235705 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:05.235709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:05.235722 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:05.235825 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:05.235827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:05.235866 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:05.235916 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:05.236153 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.236812 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.237638 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:05.237877 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:05.237948 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:05.238178 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:05.238245 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:05.238303 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:05.238389 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 11:21:05.238443 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 11:21:05.239218 17165 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:21:06.796039 16174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:06.796191 16174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:06.798373 16174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Sending DeleteTablet for 3 replicas of tablet eb7bcbf3af0e48ea8957401980bdaeeb
I20260812 11:21:06.798816 16425 tablet_service.cc:1514] Processing DeleteTablet for tablet eb7bcbf3af0e48ea8957401980bdaeeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:06 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:40696
I20260812 11:21:06.798870 16691 tablet_service.cc:1514] Processing DeleteTablet for tablet eb7bcbf3af0e48ea8957401980bdaeeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:06 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:47248
I20260812 11:21:06.798928 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet eb7bcbf3af0e48ea8957401980bdaeeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:06 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:54192
I20260812 11:21:06.799142 17261 tablet_replica.cc:330] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: stopping tablet replica
I20260812 11:21:06.799154 17259 tablet_replica.cc:330] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: stopping tablet replica
I20260812 11:21:06.799295 17259 raft_consensus.cc:2229] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:06.799297 17261 raft_consensus.cc:2229] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:06.799405 17261 raft_consensus.cc:2258] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:06.799585 17259 raft_consensus.cc:2258] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:06.800158 17259 ts_tablet_manager.cc:1905] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:06.800194 17261 ts_tablet_manager.cc:1905] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:06.802600 17261 ts_tablet_manager.cc:1918] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:21:06.802668 17261 log.cc:1196] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/eb7bcbf3af0e48ea8957401980bdaeeb
I20260812 11:21:06.802722 17262 tablet_replica.cc:330] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: stopping tablet replica
I20260812 11:21:06.802754 17259 ts_tablet_manager.cc:1918] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:21:06.802820 17259 log.cc:1196] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/eb7bcbf3af0e48ea8957401980bdaeeb
I20260812 11:21:06.802843 17262 raft_consensus.cc:2229] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:06.802945 17262 raft_consensus.cc:2258] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:06.802956 17261 ts_tablet_manager.cc:1939] T eb7bcbf3af0e48ea8957401980bdaeeb P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting consensus metadata
I20260812 11:21:06.803292 17259 ts_tablet_manager.cc:1939] T eb7bcbf3af0e48ea8957401980bdaeeb P edbda51bce9f40e182034d64e3bc850e: Deleting consensus metadata
I20260812 11:21:06.803463 17262 ts_tablet_manager.cc:1905] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:06.803599 16156 catalog_manager.cc:4841] TS 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897): tablet eb7bcbf3af0e48ea8957401980bdaeeb (table test-table [id=bb31fc0ab0f7437c9231da69f6cf9e07]) successfully deleted
I20260812 11:21:06.803911 16156 catalog_manager.cc:4841] TS edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833): tablet eb7bcbf3af0e48ea8957401980bdaeeb (table test-table [id=bb31fc0ab0f7437c9231da69f6cf9e07]) successfully deleted
I20260812 11:21:06.805397 17262 ts_tablet_manager.cc:1918] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:21:06.805457 17262 log.cc:1196] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/eb7bcbf3af0e48ea8957401980bdaeeb
I20260812 11:21:06.805656 17262 ts_tablet_manager.cc:1939] T eb7bcbf3af0e48ea8957401980bdaeeb P 8c75cbe935754b21acc6d07643dc3e50: Deleting consensus metadata
I20260812 11:21:06.806177 16157 catalog_manager.cc:4841] TS 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087): tablet eb7bcbf3af0e48ea8957401980bdaeeb (table test-table [id=bb31fc0ab0f7437c9231da69f6cf9e07]) successfully deleted
Aug 12 11:21:06 dist-test-slave-gjrz krb5kdc[16098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533666, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:21:06 dist-test-slave-gjrz krb5kdc[16098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533666, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:06.826064 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:06.818528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60902 (local address 127.12.175.254:38355)
0812 11:21:06.818754 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:06.818760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:06.818816 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:21:06.818914 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:06.818916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:06.818953 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:06.819026 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:06.819702 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:06.820255 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:06.821077 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:06.821303 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:06.821374 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:06.823514 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:06.823517 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:06.823519 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:06.823544 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:06.824888 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:06.825202 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:06.825204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:06.825205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:06.825271 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:06.825444 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:06.825446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:06.825447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:06.825604 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:06.825698 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:06.825841 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:21:06.825930 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":78,"threads_started":1}
I20260812 11:21:06.828323 16174 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:06.828691 16174 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:06.832751 16425 tablet_service.cc:1467] Processing CreateTablet for tablet 9b8a60f09d9348f4986d69aa3a13fb14 (DEFAULT_TABLE table=test-table [id=ea1ca7943b6b41e383b73e4ad86d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:06.832844 16691 tablet_service.cc:1467] Processing CreateTablet for tablet 9b8a60f09d9348f4986d69aa3a13fb14 (DEFAULT_TABLE table=test-table [id=ea1ca7943b6b41e383b73e4ad86d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:06.832895 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 9b8a60f09d9348f4986d69aa3a13fb14 (DEFAULT_TABLE table=test-table [id=ea1ca7943b6b41e383b73e4ad86d68c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:06.833047 16425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b8a60f09d9348f4986d69aa3a13fb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:06.833112 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b8a60f09d9348f4986d69aa3a13fb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:06.833112 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b8a60f09d9348f4986d69aa3a13fb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:06.835467 17276 tablet_bootstrap.cc:492] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Bootstrap starting.
I20260812 11:21:06.835577 17277 tablet_bootstrap.cc:492] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Bootstrap starting.
I20260812 11:21:06.836213 17276 tablet_bootstrap.cc:654] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:06.836390 17277 tablet_bootstrap.cc:654] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:06.836951 17278 tablet_bootstrap.cc:492] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Bootstrap starting.
I20260812 11:21:06.837224 17276 tablet_bootstrap.cc:492] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: No bootstrap required, opened a new log
I20260812 11:21:06.837308 17276 ts_tablet_manager.cc:1397] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:06.837679 17278 tablet_bootstrap.cc:654] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:06.837687 17276 raft_consensus.cc:348] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.837790 17276 raft_consensus.cc:374] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:06.837829 17276 raft_consensus.cc:729] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Initialized, Role: FOLLOWER
I20260812 11:21:06.837949 17276 consensus_queue.cc:260] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.838199 17276 ts_tablet_manager.cc:1428] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:21:06.838759 17278 tablet_bootstrap.cc:492] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: No bootstrap required, opened a new log
I20260812 11:21:06.838840 17278 ts_tablet_manager.cc:1397] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:06.838909 17277 tablet_bootstrap.cc:492] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: No bootstrap required, opened a new log
I20260812 11:21:06.838999 17277 ts_tablet_manager.cc:1397] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 11:21:06.839203 17278 raft_consensus.cc:348] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.839385 17278 raft_consensus.cc:374] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:06.839424 17278 raft_consensus.cc:729] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d2ffe2c970439ab7c7333d3dbc62c7, State: Initialized, Role: FOLLOWER
I20260812 11:21:06.839438 17277 raft_consensus.cc:348] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.839555 17277 raft_consensus.cc:374] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:06.839591 17277 raft_consensus.cc:729] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Initialized, Role: FOLLOWER
I20260812 11:21:06.839556 17278 consensus_queue.cc:260] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.839700 17277 consensus_queue.cc:260] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.839896 17278 ts_tablet_manager.cc:1428] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:06.839974 17277 ts_tablet_manager.cc:1428] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:06.858196 17240 raft_consensus.cc:482] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:06.858275 17240 raft_consensus.cc:504] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.858597 17240 leader_election.cc:288] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897), 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087)
I20260812 11:21:06.858871 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8a60f09d9348f4986d69aa3a13fb14" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" is_pre_election: true
I20260812 11:21:06.858913 16995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8a60f09d9348f4986d69aa3a13fb14" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c75cbe935754b21acc6d07643dc3e50" is_pre_election: true
I20260812 11:21:06.858973 16733 raft_consensus.cc:2454] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 0.
I20260812 11:21:06.859046 16995 raft_consensus.cc:2454] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 0.
I20260812 11:21:06.859239 16348 leader_election.cc:302] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:06.859421 17240 raft_consensus.cc:2781] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:06.859475 17240 raft_consensus.cc:482] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:06.859509 17240 raft_consensus.cc:3037] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:06.860307 17240 raft_consensus.cc:504] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.860581 17240 leader_election.cc:288] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 election: Requested vote from peers 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897), 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087)
I20260812 11:21:06.860862 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8a60f09d9348f4986d69aa3a13fb14" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
I20260812 11:21:06.860888 16995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8a60f09d9348f4986d69aa3a13fb14" candidate_uuid: "edbda51bce9f40e182034d64e3bc850e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c75cbe935754b21acc6d07643dc3e50"
I20260812 11:21:06.860962 16733 raft_consensus.cc:3037] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:06.860991 16995 raft_consensus.cc:3037] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:06.861738 16995 raft_consensus.cc:2454] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 1.
I20260812 11:21:06.861752 16733 raft_consensus.cc:2454] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbda51bce9f40e182034d64e3bc850e in term 1.
I20260812 11:21:06.862033 16348 leader_election.cc:302] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, edbda51bce9f40e182034d64e3bc850e; no voters:
I20260812 11:21:06.862183 17240 raft_consensus.cc:2781] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:06.862279 17240 raft_consensus.cc:686] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 1 LEADER]: Becoming Leader. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Running, Role: LEADER
I20260812 11:21:06.862403 17240 consensus_queue.cc:237] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.863763 16180 catalog_manager.cc:5495] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e reported cstate change: term changed from 0 to 1, leader changed from <none> to edbda51bce9f40e182034d64e3bc850e (127.12.175.193). New cstate: current_term: 1 leader_uuid: "edbda51bce9f40e182034d64e3bc850e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:06.881080 17288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:06.878090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40720 (local address 127.12.175.193:39833)
0812 11:21:06.878338 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:06.878347 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:06.878358 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:06.878396 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:06.878398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:06.878434 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:06.878501 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:06.878750 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:06.879298 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:06.880101 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:06.880335 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:06.880417 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:06.880672 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:06.880743 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:06.880799 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:06.880890 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 11:21:06.880939 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
I20260812 11:21:06.885841 16733 raft_consensus.cc:1261] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Refusing update from remote peer edbda51bce9f40e182034d64e3bc850e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:06.885874 16995 raft_consensus.cc:1261] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Refusing update from remote peer edbda51bce9f40e182034d64e3bc850e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:06.886195 17248 consensus_queue.cc:1035] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:06.886333 17240 consensus_queue.cc:1035] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:06.911032 16172 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:06.911156 16172 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:06.912847 16172 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Sending DeleteTablet for 3 replicas of tablet 9b8a60f09d9348f4986d69aa3a13fb14
I20260812 11:21:06.913401 16425 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b8a60f09d9348f4986d69aa3a13fb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:06 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:40696
I20260812 11:21:06.913407 16691 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b8a60f09d9348f4986d69aa3a13fb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:06 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:47248
I20260812 11:21:06.913407 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b8a60f09d9348f4986d69aa3a13fb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:06 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:54192
I20260812 11:21:06.913565 17261 tablet_replica.cc:330] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: stopping tablet replica
I20260812 11:21:06.913571 17262 tablet_replica.cc:330] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: stopping tablet replica
I20260812 11:21:06.913571 17259 tablet_replica.cc:330] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: stopping tablet replica
I20260812 11:21:06.913664 17262 raft_consensus.cc:2229] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:06.913661 17261 raft_consensus.cc:2229] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:06.913673 17259 raft_consensus.cc:2229] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:06.913750 17261 raft_consensus.cc:2258] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:06.913750 17262 raft_consensus.cc:2258] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:06.913800 17259 raft_consensus.cc:2258] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:06.914259 16172 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:21:06.914391 17259 ts_tablet_manager.cc:1905] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:06.914577 17261 ts_tablet_manager.cc:1905] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:21:06.914642 16172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:06.915692 17262 ts_tablet_manager.cc:1905] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:06.916646 17259 ts_tablet_manager.cc:1918] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:06.916711 17259 log.cc:1196] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/9b8a60f09d9348f4986d69aa3a13fb14
I20260812 11:21:06.916934 17259 ts_tablet_manager.cc:1939] T 9b8a60f09d9348f4986d69aa3a13fb14 P edbda51bce9f40e182034d64e3bc850e: Deleting consensus metadata
I20260812 11:21:06.916991 17261 ts_tablet_manager.cc:1918] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:06.917097 17261 log.cc:1196] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/9b8a60f09d9348f4986d69aa3a13fb14
I20260812 11:21:06.917357 17261 ts_tablet_manager.cc:1939] T 9b8a60f09d9348f4986d69aa3a13fb14 P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting consensus metadata
I20260812 11:21:06.917918 16156 catalog_manager.cc:4841] TS 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897): tablet 9b8a60f09d9348f4986d69aa3a13fb14 (table test-table [id=ea1ca7943b6b41e383b73e4ad86d68c7]) successfully deleted
I20260812 11:21:06.918076 17262 ts_tablet_manager.cc:1918] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:06.918157 17262 log.cc:1196] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/9b8a60f09d9348f4986d69aa3a13fb14
I20260812 11:21:06.918368 16156 catalog_manager.cc:4841] TS edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833): tablet 9b8a60f09d9348f4986d69aa3a13fb14 (table test-table [id=ea1ca7943b6b41e383b73e4ad86d68c7]) successfully deleted
I20260812 11:21:06.918394 17262 ts_tablet_manager.cc:1939] T 9b8a60f09d9348f4986d69aa3a13fb14 P 8c75cbe935754b21acc6d07643dc3e50: Deleting consensus metadata
I20260812 11:21:06.918955 16157 catalog_manager.cc:4841] TS 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087): tablet 9b8a60f09d9348f4986d69aa3a13fb14 (table test-table [id=ea1ca7943b6b41e383b73e4ad86d68c7]) successfully deleted
I20260812 11:21:06.920897 16425 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7406a03af84730a35d12f8f93b43af (DEFAULT_TABLE table=test-table [id=4c7f4571c7d14c178e49fc7d504f97d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:06.920961 16691 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7406a03af84730a35d12f8f93b43af (DEFAULT_TABLE table=test-table [id=4c7f4571c7d14c178e49fc7d504f97d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:06.921170 16425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7406a03af84730a35d12f8f93b43af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:06.921128 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7406a03af84730a35d12f8f93b43af (DEFAULT_TABLE table=test-table [id=4c7f4571c7d14c178e49fc7d504f97d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:06.921224 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7406a03af84730a35d12f8f93b43af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:06.921334 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7406a03af84730a35d12f8f93b43af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:06.922887 17276 tablet_bootstrap.cc:492] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e: Bootstrap starting.
I20260812 11:21:06.923350 17278 tablet_bootstrap.cc:492] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Bootstrap starting.
I20260812 11:21:06.923369 17277 tablet_bootstrap.cc:492] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Bootstrap starting.
I20260812 11:21:06.923712 17276 tablet_bootstrap.cc:654] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:06.924139 17277 tablet_bootstrap.cc:654] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:06.924194 17278 tablet_bootstrap.cc:654] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:06.924878 17276 tablet_bootstrap.cc:492] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e: No bootstrap required, opened a new log
I20260812 11:21:06.924963 17276 ts_tablet_manager.cc:1397] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:06.925101 17277 tablet_bootstrap.cc:492] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: No bootstrap required, opened a new log
I20260812 11:21:06.925175 17277 ts_tablet_manager.cc:1397] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:06.925285 17276 raft_consensus.cc:348] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.925362 17276 raft_consensus.cc:374] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:06.925354 17278 tablet_bootstrap.cc:492] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: No bootstrap required, opened a new log
I20260812 11:21:06.925383 17276 raft_consensus.cc:729] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbda51bce9f40e182034d64e3bc850e, State: Initialized, Role: FOLLOWER
I20260812 11:21:06.925436 17278 ts_tablet_manager.cc:1397] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:06.925477 17276 consensus_queue.cc:260] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.925531 17277 raft_consensus.cc:348] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.925624 17277 raft_consensus.cc:374] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:06.925653 17277 raft_consensus.cc:729] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Initialized, Role: FOLLOWER
I20260812 11:21:06.925716 17276 ts_tablet_manager.cc:1428] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:21:06.925762 17277 consensus_queue.cc:260] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.925823 17278 raft_consensus.cc:348] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.925912 17278 raft_consensus.cc:374] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:06.925943 17278 raft_consensus.cc:729] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d2ffe2c970439ab7c7333d3dbc62c7, State: Initialized, Role: FOLLOWER
I20260812 11:21:06.926024 17277 ts_tablet_manager.cc:1428] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:06.926079 17278 consensus_queue.cc:260] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.926331 17278 ts_tablet_manager.cc:1428] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:06.979583 17225 raft_consensus.cc:482] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:06.979687 17225 raft_consensus.cc:504] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.980020 17225 leader_election.cc:288] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833), 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897)
I20260812 11:21:06.980356 16468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7406a03af84730a35d12f8f93b43af" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e" is_pre_election: true
I20260812 11:21:06.980400 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7406a03af84730a35d12f8f93b43af" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" is_pre_election: true
I20260812 11:21:06.980480 16468 raft_consensus.cc:2454] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 0.
I20260812 11:21:06.980518 16733 raft_consensus.cc:2454] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 0.
I20260812 11:21:06.980775 16872 leader_election.cc:302] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, 8c75cbe935754b21acc6d07643dc3e50; no voters:
I20260812 11:21:06.980943 17225 raft_consensus.cc:2781] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:06.980997 17225 raft_consensus.cc:482] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:06.981045 17225 raft_consensus.cc:3037] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:06.981956 17225 raft_consensus.cc:504] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.982242 17225 leader_election.cc:288] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 election: Requested vote from peers edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833), 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897)
I20260812 11:21:06.982543 16468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7406a03af84730a35d12f8f93b43af" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbda51bce9f40e182034d64e3bc850e"
I20260812 11:21:06.982565 16733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7406a03af84730a35d12f8f93b43af" candidate_uuid: "8c75cbe935754b21acc6d07643dc3e50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7"
I20260812 11:21:06.982640 16468 raft_consensus.cc:3037] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:06.982662 16733 raft_consensus.cc:3037] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:06.983552 16733 raft_consensus.cc:2454] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 1.
I20260812 11:21:06.983672 16468 raft_consensus.cc:2454] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c75cbe935754b21acc6d07643dc3e50 in term 1.
I20260812 11:21:06.983853 16872 leader_election.cc:302] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85d2ffe2c970439ab7c7333d3dbc62c7, 8c75cbe935754b21acc6d07643dc3e50; no voters:
I20260812 11:21:06.984014 17225 raft_consensus.cc:2781] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:06.984114 17225 raft_consensus.cc:686] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 1 LEADER]: Becoming Leader. State: Replica: 8c75cbe935754b21acc6d07643dc3e50, State: Running, Role: LEADER
I20260812 11:21:06.984246 17225 consensus_queue.cc:237] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } }
I20260812 11:21:06.985644 16180 catalog_manager.cc:5495] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "8c75cbe935754b21acc6d07643dc3e50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c75cbe935754b21acc6d07643dc3e50" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40087 } health_report { overall_health: HEALTHY } } }
I20260812 11:21:07.009922 17302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:07.006874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54226 (local address 127.12.175.195:40087)
0812 11:21:07.007150 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:07.007157 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:07.007169 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:07.007206 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:07.007208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:07.007247 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:07.007342 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:07.007557 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:07.008055 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:07.008867 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:07.009102 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:07.009187 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:07.009437 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:07.009504 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:07.009561 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:07.009710 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:21:07.009776 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":126,"threads_started":1}
I20260812 11:21:07.015792 16468 raft_consensus.cc:1261] T 3e7406a03af84730a35d12f8f93b43af P edbda51bce9f40e182034d64e3bc850e [term 1 FOLLOWER]: Refusing update from remote peer 8c75cbe935754b21acc6d07643dc3e50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:07.016095 16733 raft_consensus.cc:1261] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Refusing update from remote peer 8c75cbe935754b21acc6d07643dc3e50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:07.016140 17221 consensus_queue.cc:1035] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edbda51bce9f40e182034d64e3bc850e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:07.016408 17221 consensus_queue.cc:1035] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d2ffe2c970439ab7c7333d3dbc62c7" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:21:07.029471 17222 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:21:08.574066 16174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:08.574205 16174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:08.576349 16174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 356f2077d2fb4edb97f10bcc932f2126: Sending DeleteTablet for 3 replicas of tablet 3e7406a03af84730a35d12f8f93b43af
I20260812 11:21:08.576804 16425 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e7406a03af84730a35d12f8f93b43af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:08 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:40696
I20260812 11:21:08.576893 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e7406a03af84730a35d12f8f93b43af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:08 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:54192
I20260812 11:21:08.577097 16691 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e7406a03af84730a35d12f8f93b43af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:08 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:47248
I20260812 11:21:08.577234 17339 tablet_replica.cc:330] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: stopping tablet replica
I20260812 11:21:08.577268 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16310
I20260812 11:21:08.582126 17339 raft_consensus.cc:2229] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:08.582324 17339 raft_consensus.cc:2258] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:08.586658 17340 tablet_replica.cc:330] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: stopping tablet replica
I20260812 11:21:08.586783 17340 raft_consensus.cc:2229] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:08.586881 17340 raft_consensus.cc:2258] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:08.587406 17339 ts_tablet_manager.cc:1905] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:08.587448 17340 ts_tablet_manager.cc:1905] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:08.589609 17340 ts_tablet_manager.cc:1918] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:21:08.589687 17340 log.cc:1196] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/3e7406a03af84730a35d12f8f93b43af
I20260812 11:21:08.589955 17340 ts_tablet_manager.cc:1939] T 3e7406a03af84730a35d12f8f93b43af P 85d2ffe2c970439ab7c7333d3dbc62c7: Deleting consensus metadata
I20260812 11:21:08.590147 17339 ts_tablet_manager.cc:1918] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:21:08.590220 17339 log.cc:1196] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/3e7406a03af84730a35d12f8f93b43af
I20260812 11:21:08.590467 17339 ts_tablet_manager.cc:1939] T 3e7406a03af84730a35d12f8f93b43af P 8c75cbe935754b21acc6d07643dc3e50: Deleting consensus metadata
I20260812 11:21:08.590616 16156 catalog_manager.cc:4841] TS 85d2ffe2c970439ab7c7333d3dbc62c7 (127.12.175.194:42897): tablet 3e7406a03af84730a35d12f8f93b43af (table test-table [id=4c7f4571c7d14c178e49fc7d504f97d9]) successfully deleted
I20260812 11:21:08.591033 16157 catalog_manager.cc:4841] TS 8c75cbe935754b21acc6d07643dc3e50 (127.12.175.195:40087): tablet 3e7406a03af84730a35d12f8f93b43af (table test-table [id=4c7f4571c7d14c178e49fc7d504f97d9]) successfully deleted
W20260812 11:21:08.594658 16156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:39833 (error 108)
I20260812 11:21:08.594890 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16575
I20260812 11:21:08.601864 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:08.598852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39833 (local address 127.0.0.1:40734)
0812 11:21:08.601710 (+ 2858us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:08.601781 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:39833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2776,"thread_start_us":1138,"threads_started":1}
W20260812 11:21:08.602006 16156 catalog_manager.cc:4584] TS edbda51bce9f40e182034d64e3bc850e (127.12.175.193:39833): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3e7406a03af84730a35d12f8f93b43af: Network error: Client connection negotiation failed: client connection to 127.12.175.193:39833: connect: Connection refused (error 111)
I20260812 11:21:08.605044 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16835
I20260812 11:21:08.617168 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16125
2026-08-12T11:21:08Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6089 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:08 dist-test-slave-gjrz krb5kdc[17350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:08 dist-test-slave-gjrz krb5kdc[17350](info): set up 2 sockets
Aug 12 11:21:08 dist-test-slave-gjrz krb5kdc[17350](info): commencing operation
krb5kdc: starting...
W20260812 11:21:09.819732 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:09 dist-test-slave-gjrz krb5kdc[17350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:09.930300 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45531
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:45531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:10.035943 17376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:10.036166 17376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:10.036203 17376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:10.040082 17376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:10.040129 17376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:10.040148 17376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:10.040166 17376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:10.040180 17376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:10.045174 17376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:45531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:10.046031 17376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:10.046896 17376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:21:10.054816 17376 server_base.cc:1034] running on GCE node
W20260812 11:21:10.054874 17385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.054956 17383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.054885 17388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:10.055656 17376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:10.056641 17376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:10.057798 17376 hybrid_clock.cc:648] HybridClock initialized: now 1786533670057784 us; error 25 us; skew 500 ppm
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:10.060289 17376 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:10.061053 17376 webserver.cc:460] Webserver started at http://127.12.175.254:44031/ using document root <none> and password file <none>
I20260812 11:21:10.061546 17376 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:10.061609 17376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:10.061787 17376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:10.063712 17376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "4332caf14269473386430fce743bc7c2"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "4ed1d600a211dbfe86caccf2d25424b9"
server_key_iv: "914f9288009496a0528798e10d1672a6"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.064218 17376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "4332caf14269473386430fce743bc7c2"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "4ed1d600a211dbfe86caccf2d25424b9"
server_key_iv: "914f9288009496a0528798e10d1672a6"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.067524 17376 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:10.069586 17399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.070631 17376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:10.070737 17376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "4332caf14269473386430fce743bc7c2"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "4ed1d600a211dbfe86caccf2d25424b9"
server_key_iv: "914f9288009496a0528798e10d1672a6"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.070827 17376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:10.086229 17376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:10.088676 17376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:10.088835 17376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:10.095323 17376 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:45531
I20260812 11:21:10.095376 17494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:45531 every 8 connection(s)
I20260812 11:21:10.096200 17376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:10.098747 17497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:10.103802 17497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2: Bootstrap starting.
I20260812 11:21:10.105053 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17376
I20260812 11:21:10.105159 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:10.105427 12991 external_mini_cluster.cc:1428] Setting key 64fbfc2a883bf1d4ace0e6d8f87e0e93
I20260812 11:21:10.106359 17497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:10.107118 17497 log.cc:824] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:10.109163 17497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2: No bootstrap required, opened a new log
I20260812 11:21:10.113123 17497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4332caf14269473386430fce743bc7c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45531 } }
I20260812 11:21:10.113392 17497 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:10.113449 17497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4332caf14269473386430fce743bc7c2, State: Initialized, Role: FOLLOWER
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:10.113826 17497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4332caf14269473386430fce743bc7c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45531 } }
I20260812 11:21:10.113946 17497 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:10.114010 17497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:10.114113 17497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:10.115088 17497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4332caf14269473386430fce743bc7c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45531 } }
I20260812 11:21:10.115463 17497 leader_election.cc:302] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4332caf14269473386430fce743bc7c2; no voters:
I20260812 11:21:10.115808 17497 leader_election.cc:288] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:10.115887 17512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:10.116078 17512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4332caf14269473386430fce743bc7c2, State: Running, Role: LEADER
I20260812 11:21:10.116407 17512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4332caf14269473386430fce743bc7c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45531 } }
I20260812 11:21:10.117012 17497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:10.117865 17513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4332caf14269473386430fce743bc7c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4332caf14269473386430fce743bc7c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45531 } } }
I20260812 11:21:10.117986 17513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:10.118351 17514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4332caf14269473386430fce743bc7c2. Latest consensus state: current_term: 1 leader_uuid: "4332caf14269473386430fce743bc7c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4332caf14269473386430fce743bc7c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45531 } } }
I20260812 11:21:10.119225 17514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:10.120018 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.106483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49518 (local address 127.12.175.254:45531)
0812 11:21:10.106848 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:10.106863 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:10.106897 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:21:10.107574 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:10.107597 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:10.107968 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:10.108236 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:10.109101 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.110046 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.111174 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.111693 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.111805 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.114463 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:10.114470 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:10.114485 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:10.114515 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:10.116345 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.116864 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.116869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.116875 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.117008 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.117379 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.117382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.117384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.117878 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:10.118060 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:10.118853 (+ 793us) server_negotiation.cc:299] Negotiation successful
0812 11:21:10.119121 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":92,"threads_started":1}
W20260812 11:21:10.122121 17537 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:10.122201 17537 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:10.122278 17524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:10.123153 17524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:10.128572 17524 catalog_manager.cc:1347] Generated new cluster ID: 172513167d0549acb08abb07fad0f4ef
I20260812 11:21:10.128628 17524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:10.141288 17524 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:10.142120 17524 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:10.156172 17524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4332caf14269473386430fce743bc7c2: Generated new TSK 0
I20260812 11:21:10.156731 17524 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:10.189515 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45531
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:10.295306 17546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:10.295512 17546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:10.295549 17546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:10.299335 17546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:10.299379 17546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:10.299432 17546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:10.304337 17546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:10.305150 17546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:10.305998 17546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:10.314692 17554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.314697 17552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.314705 17556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:10.314765 17546 server_base.cc:1034] running on GCE node
I20260812 11:21:10.315248 17546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:10.315858 17546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:10.317037 17546 hybrid_clock.cc:648] HybridClock initialized: now 1786533670317021 us; error 29 us; skew 500 ppm
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:10.319695 17546 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:10.320451 17546 webserver.cc:460] Webserver started at http://127.12.175.193:43849/ using document root <none> and password file <none>
I20260812 11:21:10.320955 17546 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:10.321022 17546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:10.321214 17546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:10.323081 17546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "f4e7c62bdc9445c6a9fbd5b672de33a4"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "dd81e06a11c0ff125b65a6cd56f61c90"
server_key_iv: "7d19a7dd127077b5bfb5eee65ceae857"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.323643 17546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "f4e7c62bdc9445c6a9fbd5b672de33a4"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "dd81e06a11c0ff125b65a6cd56f61c90"
server_key_iv: "7d19a7dd127077b5bfb5eee65ceae857"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.327013 17546 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:10.329234 17572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.330307 17546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:21:10.330412 17546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "f4e7c62bdc9445c6a9fbd5b672de33a4"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "dd81e06a11c0ff125b65a6cd56f61c90"
server_key_iv: "7d19a7dd127077b5bfb5eee65ceae857"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.330499 17546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:10.356261 17546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:10.358732 17546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:10.358888 17546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:10.359428 17546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:10.360167 17546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:10.360210 17546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.360251 17546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:10.360280 17546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.368149 17546 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:46105
I20260812 11:21:10.368204 17804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:46105 every 8 connection(s)
I20260812 11:21:10.368925 17546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:10.374883 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17546
I20260812 11:21:10.374979 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:10.375227 12991 external_mini_cluster.cc:1428] Setting key f7abca403bead538714f8ce77cdc36ba
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:10.381598 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.370528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:57129 (local address 127.12.175.254:45531)
0812 11:21:10.370658 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:10.370663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:10.371484 (+ 821us) server_negotiation.cc:407] Connection header received
0812 11:21:10.372668 (+ 1184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:10.372670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:10.372715 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:10.372783 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:10.373875 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.374402 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.375630 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.375926 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.376022 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.378446 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:10.378449 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:10.378451 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:10.378474 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:10.379743 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.380196 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.380200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.380202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.380290 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.380610 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.380613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.380615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.380789 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:10.380874 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:10.381323 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 11:21:10.381439 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:10.382272 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.370880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45531 (local address 127.12.175.193:57129)
0812 11:21:10.371350 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:10.371395 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:10.372490 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:10.372922 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:10.372928 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:10.373257 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:10.373762 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:10.373779 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.374501 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.374503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:10.375527 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:10.375537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.376072 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.376075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:10.376222 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.376778 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:10.376798 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:10.378296 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:10.379850 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:10.379856 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:10.379869 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:10.380105 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:10.380372 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:10.380375 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:10.380377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:10.380514 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:10.380888 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:10.380894 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:10.381106 (+ 212us) client_negotiation.cc:769] Sending connection context
0812 11:21:10.381259 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 11:21:10.381549 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":121,"threads_started":1}
I20260812 11:21:10.383338 17811 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45531
I20260812 11:21:10.383579 17811 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:10.384179 17811 heartbeater.cc:511] Master 127.12.175.254:45531 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:10.385676 17433 ts_manager.cc:194] Registered new tserver with Master: f4e7c62bdc9445c6a9fbd5b672de33a4 (127.12.175.193:46105)
I20260812 11:21:10.386782 17433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:57129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:10.401368 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45531
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:10.511731 17819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:10.511984 17819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:10.512055 17819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:10.516661 17819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:10.516714 17819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:10.516778 17819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:10.523844 17819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:10.524796 17819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:10.525723 17819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:10.534647 17828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.534715 17827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.534658 17834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:10.535000 17819 server_base.cc:1034] running on GCE node
I20260812 11:21:10.535399 17819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:10.535996 17819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:10.537161 17819 hybrid_clock.cc:648] HybridClock initialized: now 1786533670537136 us; error 35 us; skew 500 ppm
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:10.539642 17819 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:10.540362 17819 webserver.cc:460] Webserver started at http://127.12.175.194:35773/ using document root <none> and password file <none>
I20260812 11:21:10.540836 17819 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:10.540889 17819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:10.541047 17819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:10.542886 17819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "30ab9b52af754dfca71a22f66bb0b21d"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "5aa94c3e5c0baf0526aa22c5a924e8e2"
server_key_iv: "2e454b4f47efd0e38abf18df3446e362"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.543407 17819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "30ab9b52af754dfca71a22f66bb0b21d"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "5aa94c3e5c0baf0526aa22c5a924e8e2"
server_key_iv: "2e454b4f47efd0e38abf18df3446e362"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.546713 17819 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:10.548900 17846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.550004 17819 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:21:10.550105 17819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "30ab9b52af754dfca71a22f66bb0b21d"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "5aa94c3e5c0baf0526aa22c5a924e8e2"
server_key_iv: "2e454b4f47efd0e38abf18df3446e362"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.550189 17819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:10.563150 17819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:10.565497 17819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:10.565655 17819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:10.566134 17819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:10.566867 17819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:10.566920 17819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.566969 17819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:10.566996 17819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.574960 17819 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:44663
I20260812 11:21:10.574998 18060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:44663 every 8 connection(s)
I20260812 11:21:10.575781 17819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:10.576602 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17819
I20260812 11:21:10.576701 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:10.576956 12991 external_mini_cluster.cc:1428] Setting key 708366147621852f0c8008ef830ec2c8
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:21:10.588898 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.577322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39451 (local address 127.12.175.254:45531)
0812 11:21:10.577439 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:10.577442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:10.578274 (+ 832us) server_negotiation.cc:407] Connection header received
0812 11:21:10.579550 (+ 1276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:10.579553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:10.579607 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:10.579679 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:10.580971 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.581479 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.582995 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.583244 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.583354 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.585744 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:10.585747 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:10.585749 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:10.585771 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:10.587005 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.587533 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.587542 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.587544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.587618 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.587919 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.587923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.587925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.588101 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:10.588184 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:10.588631 (+ 447us) server_negotiation.cc:299] Negotiation successful
0812 11:21:10.588742 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:10.589555 18064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.577682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45531 (local address 127.12.175.194:39451)
0812 11:21:10.578130 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:10.578182 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:10.579366 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:10.579835 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:10.579841 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:10.580222 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:10.580817 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:10.580835 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.581602 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.581605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:10.582877 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:10.582890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.583422 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.583427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:10.583625 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.584110 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:10.584130 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:10.585596 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:10.587111 (+ 1515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:10.587117 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:10.587130 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:10.587434 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:10.587702 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:10.587705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:10.587707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:10.587834 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:10.588202 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:10.588208 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:10.588418 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 11:21:10.588568 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:21:10.588848 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
I20260812 11:21:10.590644 18062 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45531
I20260812 11:21:10.590854 18062 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:10.591289 18062 heartbeater.cc:511] Master 127.12.175.254:45531 requested a full tablet report, sending...
I20260812 11:21:10.592208 17433 ts_manager.cc:194] Registered new tserver with Master: 30ab9b52af754dfca71a22f66bb0b21d (127.12.175.194:44663)
I20260812 11:21:10.592898 17433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:39451
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:10.603538 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45531
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:10.708671 18068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:10.708881 18068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:10.708920 18068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:10.712759 18068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:10.712806 18068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:10.712859 18068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:10.717773 18068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:10.718605 18068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:10.719507 18068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:10.727948 18076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:10.728010 18068 server_base.cc:1034] running on GCE node
W20260812 11:21:10.727948 18073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:10.728245 18080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:10.728641 18068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:10.729202 18068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:10.730355 18068 hybrid_clock.cc:648] HybridClock initialized: now 1786533670730341 us; error 25 us; skew 500 ppm
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:10.732895 18068 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:10.733752 18068 webserver.cc:460] Webserver started at http://127.12.175.195:39645/ using document root <none> and password file <none>
I20260812 11:21:10.734247 18068 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:10.734310 18068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:10.734535 18068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:10.736433 18068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "3e467b07ebd5497da38c104fd089fb57"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "d03cfd11129f9b7ba24505a8d7cdddab"
server_key_iv: "ededfbf725e4b575cc2b737359017d91"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.736974 18068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "3e467b07ebd5497da38c104fd089fb57"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "d03cfd11129f9b7ba24505a8d7cdddab"
server_key_iv: "ededfbf725e4b575cc2b737359017d91"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.740347 18068 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:10.742524 18100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.743636 18068 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:10.743737 18068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "3e467b07ebd5497da38c104fd089fb57"
format_stamp: "Formatted at 2026-08-12 11:21:10 on dist-test-slave-gjrz"
server_key: "d03cfd11129f9b7ba24505a8d7cdddab"
server_key_iv: "ededfbf725e4b575cc2b737359017d91"
server_key_version: "encryptionkey@0"
I20260812 11:21:10.743819 18068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:10.756500 18068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:10.758895 18068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:10.759037 18068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:10.759558 18068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:10.760277 18068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:10.760322 18068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.760357 18068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:10.760371 18068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:10.768155 18068 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:43873
I20260812 11:21:10.768178 18328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:43873 every 8 connection(s)
I20260812 11:21:10.768905 18068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[17350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533670, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:10.778640 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18068
I20260812 11:21:10.778738 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:10.779021 12991 external_mini_cluster.cc:1428] Setting key fa16d73b38b5b151886f2f82fde7f781
I20260812 11:21:10.781226 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.770609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:35235 (local address 127.12.175.254:45531)
0812 11:21:10.770729 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:10.770732 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:10.771484 (+ 752us) server_negotiation.cc:407] Connection header received
0812 11:21:10.772720 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:10.772724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:10.772782 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:10.772852 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:10.773999 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.774525 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.775680 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.775897 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.775987 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.778088 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:10.778091 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:10.778094 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:10.778118 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:10.779368 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.779818 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.779821 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.779822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.779896 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:10.780208 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:10.780212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:10.780213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:10.780401 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:10.780474 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:10.781015 (+ 541us) server_negotiation.cc:299] Negotiation successful
0812 11:21:10.781112 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:21:10.781956 18332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:10.770916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45531 (local address 127.12.175.195:35235)
0812 11:21:10.771358 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:10.771398 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:10.772513 (+ 1115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:10.773020 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:10.773026 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:10.773364 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:10.773860 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:10.773875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.774646 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.774650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:10.775565 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:10.775576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:10.776029 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:10.776034 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:10.776193 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:10.776618 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:10.776633 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:10.777932 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:10.779472 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:10.779477 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:10.779487 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:10.779728 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:10.779985 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:10.779988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:10.779990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:10.780136 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:10.780496 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:10.780502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:10.780778 (+ 276us) client_negotiation.cc:769] Sending connection context
0812 11:21:10.780951 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 11:21:10.781216 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":122,"threads_started":1}
I20260812 11:21:10.782938 18329 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45531
I20260812 11:21:10.783142 18329 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:10.783597 18329 heartbeater.cc:511] Master 127.12.175.254:45531 requested a full tablet report, sending...
I20260812 11:21:10.784468 17433 ts_manager.cc:194] Registered new tserver with Master: 3e467b07ebd5497da38c104fd089fb57 (127.12.175.195:43873)
I20260812 11:21:10.784976 17433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:35235
I20260812 11:21:10.792382 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:21:10.805047 17505 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:10.803805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49524 (local address 127.12.175.254:45531)
0812 11:21:10.803915 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:10.803919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:10.804091 (+ 172us) server_negotiation.cc:407] Connection header received
0812 11:21:10.804207 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:10.804210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:10.804248 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:10.804308 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:10.804950 (+ 642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49524: BlockingRecv error: recv got EOF from 127.0.0.1:49524 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:21:10.806106 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17546
I20260812 11:21:10.846263 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17819
I20260812 11:21:10.860692 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18068
I20260812 11:21:10.867882 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17376
2026-08-12T11:21:10Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2240 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[18346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[18346](info): set up 2 sockets
Aug 12 11:21:10 dist-test-slave-gjrz krb5kdc[18346](info): commencing operation
krb5kdc: starting...
W20260812 11:21:12.049466 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:12 dist-test-slave-gjrz krb5kdc[18346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:12.159484 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36707
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:36707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:12.265602 18363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:12.265816 18363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:12.265852 18363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:12.269824 18363 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:12.269874 18363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:12.269891 18363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:12.269906 18363 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:12.269922 18363 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:12.274791 18363 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:36707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:12.275626 18363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:12.276479 18363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:12.284137 18374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:12.284180 18377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:12.284369 18363 server_base.cc:1034] running on GCE node
W20260812 11:21:12.284171 18382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:12.284965 18363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:12.285916 18363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:12.287074 18363 hybrid_clock.cc:648] HybridClock initialized: now 1786533672287060 us; error 25 us; skew 500 ppm
Aug 12 11:21:12 dist-test-slave-gjrz krb5kdc[18346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533672, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:12.292438 18363 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:12.293215 18363 webserver.cc:460] Webserver started at http://127.12.175.254:34483/ using document root <none> and password file <none>
I20260812 11:21:12.293694 18363 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:12.293756 18363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:12.293943 18363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:12.295888 18363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "c391a54206794b10992b15fe83561803"
format_stamp: "Formatted at 2026-08-12 11:21:12 on dist-test-slave-gjrz"
server_key: "441008ed474c99997fabf8d7835bc1e0"
server_key_iv: "fc96d3a27ee318983d22daee035e7bf1"
server_key_version: "encryptionkey@0"
I20260812 11:21:12.296417 18363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "c391a54206794b10992b15fe83561803"
format_stamp: "Formatted at 2026-08-12 11:21:12 on dist-test-slave-gjrz"
server_key: "441008ed474c99997fabf8d7835bc1e0"
server_key_iv: "fc96d3a27ee318983d22daee035e7bf1"
server_key_version: "encryptionkey@0"
I20260812 11:21:12.299777 18363 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:12.301934 18395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:12.303012 18363 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:12.303133 18363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "c391a54206794b10992b15fe83561803"
format_stamp: "Formatted at 2026-08-12 11:21:12 on dist-test-slave-gjrz"
server_key: "441008ed474c99997fabf8d7835bc1e0"
server_key_iv: "fc96d3a27ee318983d22daee035e7bf1"
server_key_version: "encryptionkey@0"
I20260812 11:21:12.303220 18363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:12.319377 18363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:12.321754 18363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:12.321923 18363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:12.328167 18363 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:36707
I20260812 11:21:12.328404 18493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:36707 every 8 connection(s)
I20260812 11:21:12.328995 18363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:12.331557 18494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:12.334478 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18363
I20260812 11:21:12.334600 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:12.334882 12991 external_mini_cluster.cc:1428] Setting key 6e3a22c76d66b3b35581d2fda971ebca
I20260812 11:21:12.337158 18494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803: Bootstrap starting.
I20260812 11:21:12.339164 18494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:12.339859 18494 log.cc:824] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:12.341552 18494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803: No bootstrap required, opened a new log
Aug 12 11:21:12 dist-test-slave-gjrz krb5kdc[18346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:12.345371 18494 raft_consensus.cc:348] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c391a54206794b10992b15fe83561803" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36707 } }
I20260812 11:21:12.345584 18494 raft_consensus.cc:374] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:12.345643 18494 raft_consensus.cc:729] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c391a54206794b10992b15fe83561803, State: Initialized, Role: FOLLOWER
I20260812 11:21:12.346079 18494 consensus_queue.cc:260] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c391a54206794b10992b15fe83561803" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36707 } }
I20260812 11:21:12.346221 18494 raft_consensus.cc:388] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:12.346292 18494 raft_consensus.cc:482] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:12.346395 18494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:12.347326 18494 raft_consensus.cc:504] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c391a54206794b10992b15fe83561803" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36707 } }
I20260812 11:21:12.347672 18494 leader_election.cc:302] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c391a54206794b10992b15fe83561803; no voters:
I20260812 11:21:12.347980 18494 leader_election.cc:288] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:12.348070 18509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:12.348289 18509 raft_consensus.cc:686] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [term 1 LEADER]: Becoming Leader. State: Replica: c391a54206794b10992b15fe83561803, State: Running, Role: LEADER
I20260812 11:21:12.348328 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:12.336163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42908 (local address 127.12.175.254:36707)
0812 11:21:12.336657 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:12.336671 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:12.336707 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:21:12.337359 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:12.337378 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:12.337684 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:12.337982 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:12.338773 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:12.339807 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:12.340841 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:12.341290 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:12.341433 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:12.343990 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:12.343995 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:12.344006 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:12.344031 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:12.345499 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:12.345980 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:12.345985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:12.345990 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:12.346102 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:12.346377 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:12.346380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:12.346382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:12.346780 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:12.346933 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:12.347207 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 11:21:12.347485 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":128,"threads_started":1}
I20260812 11:21:12.348656 18509 consensus_queue.cc:237] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c391a54206794b10992b15fe83561803" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36707 } }
I20260812 11:21:12.349113 18494 sys_catalog.cc:564] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:12.350266 18514 sys_catalog.cc:455] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c391a54206794b10992b15fe83561803. Latest consensus state: current_term: 1 leader_uuid: "c391a54206794b10992b15fe83561803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c391a54206794b10992b15fe83561803" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36707 } } }
I20260812 11:21:12.350394 18514 sys_catalog.cc:458] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:12.350701 18513 sys_catalog.cc:455] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c391a54206794b10992b15fe83561803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c391a54206794b10992b15fe83561803" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36707 } } }
I20260812 11:21:12.350781 18513 sys_catalog.cc:458] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:12.351159 18530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:12.351410 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:21:12.354238 18530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:12.359576 18530 catalog_manager.cc:1347] Generated new cluster ID: 8489110544b04999ae4e6e0dee3b9308
I20260812 11:21:12.359694 18530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:12.370930 18530 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:12.371970 18530 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:12.374902 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:12.369671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.12.175.254:36707)
0812 11:21:12.369763 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:12.369767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:12.370041 (+ 274us) server_negotiation.cc:407] Connection header received
0812 11:21:12.370201 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:12.370204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:12.370242 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:12.370279 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:12.370839 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:12.371660 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:12.372807 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:12.373144 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:12.373236 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:12.374020 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:12.374023 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:12.374026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:12.374467 (+ 441us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:12.374495 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:12.374512 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:12.374598 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:12.374707 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 11:21:12.374773 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":27}
I20260812 11:21:12.378665 18530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c391a54206794b10992b15fe83561803: Generated new TSK 0
I20260812 11:21:12.379177 18530 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:12.385038 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18363
2026-08-12T11:21:12Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1529 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:12 dist-test-slave-gjrz krb5kdc[18568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:12 dist-test-slave-gjrz krb5kdc[18568](info): set up 2 sockets
Aug 12 11:21:12 dist-test-slave-gjrz krb5kdc[18568](info): commencing operation
krb5kdc: starting...
W20260812 11:21:13.586238 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:13 dist-test-slave-gjrz krb5kdc[18568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:13.696039 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:37427
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:37427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:13.801661 18599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:13.801885 18599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:13.801923 18599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:13.805742 18599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:13.805788 18599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:13.805806 18599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:13.805820 18599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:13.805833 18599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:13.810703 18599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:37427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:37427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:13.811556 18599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:13.812393 18599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:13.820091 18616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:13.820108 18622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:13.820096 18617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:13.820276 18599 server_base.cc:1034] running on GCE node
I20260812 11:21:13.820890 18599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:13.821898 18599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:13.823063 18599 hybrid_clock.cc:648] HybridClock initialized: now 1786533673823057 us; error 35 us; skew 500 ppm
Aug 12 11:21:13 dist-test-slave-gjrz krb5kdc[18568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533673, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:13.825603 18599 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:13.826377 18599 webserver.cc:460] Webserver started at http://127.12.175.254:33275/ using document root <none> and password file <none>
I20260812 11:21:13.826867 18599 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:13.826929 18599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:13.827111 18599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:13.829011 18599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "793bfc5e28d449fca66018b4437240ae"
format_stamp: "Formatted at 2026-08-12 11:21:13 on dist-test-slave-gjrz"
server_key: "efefa2f1d993793f9b1440d5d0255952"
server_key_iv: "6d3f78cc40d4bc2b3568f40a83e4eea2"
server_key_version: "encryptionkey@0"
I20260812 11:21:13.829523 18599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "793bfc5e28d449fca66018b4437240ae"
format_stamp: "Formatted at 2026-08-12 11:21:13 on dist-test-slave-gjrz"
server_key: "efefa2f1d993793f9b1440d5d0255952"
server_key_iv: "6d3f78cc40d4bc2b3568f40a83e4eea2"
server_key_version: "encryptionkey@0"
I20260812 11:21:13.832885 18599 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:13.834987 18632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:13.836084 18599 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:13.836190 18599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "793bfc5e28d449fca66018b4437240ae"
format_stamp: "Formatted at 2026-08-12 11:21:13 on dist-test-slave-gjrz"
server_key: "efefa2f1d993793f9b1440d5d0255952"
server_key_iv: "6d3f78cc40d4bc2b3568f40a83e4eea2"
server_key_version: "encryptionkey@0"
I20260812 11:21:13.836275 18599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:13.845680 18599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:13.848392 18599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:13.848547 18599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:13.854682 18599 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:37427
I20260812 11:21:13.854918 18737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:37427 every 8 connection(s)
I20260812 11:21:13.855537 18599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:13.858000 18738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:13.860683 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18599
I20260812 11:21:13.860807 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:13.861076 12991 external_mini_cluster.cc:1428] Setting key c5c588dbf3b95315b13e6afffa0f7378
I20260812 11:21:13.863469 18738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae: Bootstrap starting.
I20260812 11:21:13.865713 18738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:13.866389 18738 log.cc:824] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:13.868199 18738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae: No bootstrap required, opened a new log
Aug 12 11:21:13 dist-test-slave-gjrz krb5kdc[18568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:13.871649 18738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793bfc5e28d449fca66018b4437240ae" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37427 } }
I20260812 11:21:13.871893 18738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:13.871999 18738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793bfc5e28d449fca66018b4437240ae, State: Initialized, Role: FOLLOWER
I20260812 11:21:13.872431 18738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793bfc5e28d449fca66018b4437240ae" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37427 } }
I20260812 11:21:13.872589 18738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:13.872658 18738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:13.872751 18738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:13.873533 18738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793bfc5e28d449fca66018b4437240ae" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37427 } }
I20260812 11:21:13.873838 18738 leader_election.cc:302] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 793bfc5e28d449fca66018b4437240ae; no voters:
I20260812 11:21:13.874116 18738 leader_election.cc:288] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:13.874197 18748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:13.874356 18748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [term 1 LEADER]: Becoming Leader. State: Replica: 793bfc5e28d449fca66018b4437240ae, State: Running, Role: LEADER
I20260812 11:21:13.874616 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:13.862290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51956 (local address 127.12.175.254:37427)
0812 11:21:13.862671 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:13.862685 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:13.862718 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:21:13.863328 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:13.863347 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:13.863663 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:13.863919 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:13.864780 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:13.865730 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:13.866575 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:13.867111 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:13.867307 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:13.869460 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:13.869466 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:13.869482 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:13.869512 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:13.871859 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:13.872305 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:13.872311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:13.872316 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:13.872453 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:13.872714 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:13.872718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:13.872720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:13.873076 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:13.873259 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:13.873540 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 11:21:13.873822 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":117,"threads_started":1}
I20260812 11:21:13.874698 18748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793bfc5e28d449fca66018b4437240ae" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37427 } }
I20260812 11:21:13.875253 18738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:13.876377 18751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "793bfc5e28d449fca66018b4437240ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793bfc5e28d449fca66018b4437240ae" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37427 } } }
I20260812 11:21:13.876649 18752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 793bfc5e28d449fca66018b4437240ae. Latest consensus state: current_term: 1 leader_uuid: "793bfc5e28d449fca66018b4437240ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793bfc5e28d449fca66018b4437240ae" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37427 } } }
I20260812 11:21:13.877082 18752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:13.877455 18751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:13.879714 18773 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:13.879777 18773 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:13.879832 18774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:13.880578 18774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:13.884999 18774 catalog_manager.cc:1347] Generated new cluster ID: a731f4628358491186b4e6f97ac130bb
I20260812 11:21:13.885068 18774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:13.902412 18774 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:13.903240 18774 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:13.911897 18774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 793bfc5e28d449fca66018b4437240ae: Generated new TSK 0
I20260812 11:21:13.912433 18774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:13.940412 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37427
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:14.045009 18784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:14.045213 18784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:14.045253 18784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:14.049122 18784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:14.049170 18784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:14.049235 18784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:14.054126 18784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:14.055002 18784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:14.055886 18784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:14.064491 18797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:14.064601 18784 server_base.cc:1034] running on GCE node
W20260812 11:21:14.064472 18795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:14.064464 18794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:14.065107 18784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:14.065649 18784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:14.066797 18784 hybrid_clock.cc:648] HybridClock initialized: now 1786533674066783 us; error 24 us; skew 500 ppm
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:14.069275 18784 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:14.070122 18784 webserver.cc:460] Webserver started at http://127.12.175.193:32881/ using document root <none> and password file <none>
I20260812 11:21:14.070600 18784 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:14.070660 18784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:14.070847 18784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:14.072686 18784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "f4fde32fbcb340a2908ea0c8772aaeed"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "1d70b200e9a154c23301a1a1cf6233fc"
server_key_iv: "4ec8db53ea55c79fceb3b74b9552345b"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.073195 18784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "f4fde32fbcb340a2908ea0c8772aaeed"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "1d70b200e9a154c23301a1a1cf6233fc"
server_key_iv: "4ec8db53ea55c79fceb3b74b9552345b"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.076817 18784 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:14.078925 18810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.080050 18784 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:14.080144 18784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "f4fde32fbcb340a2908ea0c8772aaeed"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "1d70b200e9a154c23301a1a1cf6233fc"
server_key_iv: "4ec8db53ea55c79fceb3b74b9552345b"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.080235 18784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:14.088704 18784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:14.091058 18784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:14.091207 18784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:14.091718 18784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:14.092429 18784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:14.092473 18784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.092511 18784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:14.092540 18784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.100431 18784 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:45165
I20260812 11:21:14.100461 19010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:45165 every 8 connection(s)
I20260812 11:21:14.101172 18784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:14.105438 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18784
I20260812 11:21:14.105553 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:14.105803 12991 external_mini_cluster.cc:1428] Setting key 375a982ac38b7ee8192b8b8be54819d6
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:14.114166 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.102709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:36619 (local address 127.12.175.254:37427)
0812 11:21:14.102839 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:14.102843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:14.103581 (+ 738us) server_negotiation.cc:407] Connection header received
0812 11:21:14.104836 (+ 1255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:14.104839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:14.104896 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:14.104963 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:14.106162 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.106885 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.108358 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.108593 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.108672 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.110960 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:14.110963 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:14.110965 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:14.110987 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:14.112331 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.112792 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.112795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.112796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.112874 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.113186 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.113189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.113191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.113356 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:14.113439 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:14.113882 (+ 443us) server_negotiation.cc:299] Negotiation successful
0812 11:21:14.114003 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":45}
I20260812 11:21:14.114826 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.103018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:37427 (local address 127.12.175.193:36619)
0812 11:21:14.103454 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:14.103493 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:14.104643 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:14.105135 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:14.105142 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:14.105452 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:14.105995 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:14.106012 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.107021 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.107025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:14.108246 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:14.108259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.108729 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.108733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:14.108910 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.109436 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:14.109451 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:14.110813 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:14.112438 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:14.112444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:14.112457 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:14.112699 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:14.112955 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:14.112958 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:14.112960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:14.113099 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:14.113453 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:14.113459 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:14.113669 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 11:21:14.113823 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 11:21:14.114121 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:14.115916 19011 heartbeater.cc:347] Connected to a master server at 127.12.175.254:37427
I20260812 11:21:14.116115 19011 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:14.116519 19011 heartbeater.cc:511] Master 127.12.175.254:37427 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
I20260812 11:21:14.117903 18665 ts_manager.cc:194] Registered new tserver with Master: f4fde32fbcb340a2908ea0c8772aaeed (127.12.175.193:45165)
I20260812 11:21:14.118965 18665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:36619
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:14.130784 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37427
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:14.235957 19018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:14.236168 19018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:14.236207 19018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:14.240085 19018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:14.240131 19018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:14.240186 19018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:14.245138 19018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:14.246001 19018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:14.246884 19018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:21:14.255738 19018 server_base.cc:1034] running on GCE node
W20260812 11:21:14.255792 19031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:14.255764 19037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:14.255913 19028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:14.256422 19018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:14.256968 19018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:14.258127 19018 hybrid_clock.cc:648] HybridClock initialized: now 1786533674258105 us; error 33 us; skew 500 ppm
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:14.260766 19018 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:14.261545 19018 webserver.cc:460] Webserver started at http://127.12.175.194:42075/ using document root <none> and password file <none>
I20260812 11:21:14.262042 19018 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:14.262102 19018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:14.262312 19018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:14.264216 19018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "2c9b95baadfb405db06818fa81af2337"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "c54db309082f0c3bfcc2f82e2533e31a"
server_key_iv: "41f63cc77ab7196ade748721ad8a44e8"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.264744 19018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "2c9b95baadfb405db06818fa81af2337"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "c54db309082f0c3bfcc2f82e2533e31a"
server_key_iv: "41f63cc77ab7196ade748721ad8a44e8"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.268250 19018 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:14.270536 19050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.271677 19018 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:14.271778 19018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "2c9b95baadfb405db06818fa81af2337"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "c54db309082f0c3bfcc2f82e2533e31a"
server_key_iv: "41f63cc77ab7196ade748721ad8a44e8"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.271871 19018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:14.289397 19018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:14.292215 19018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:14.292373 19018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:14.292888 19018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:14.293638 19018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:14.293684 19018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.293723 19018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:14.293752 19018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.301628 19018 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:43707
I20260812 11:21:14.301657 19247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:43707 every 8 connection(s)
I20260812 11:21:14.302412 19018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:14.305897 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19018
I20260812 11:21:14.306010 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:14.306322 12991 external_mini_cluster.cc:1428] Setting key ef67992322052611d6e8d2040f19c930
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:14.315671 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.304011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:35511 (local address 127.12.175.254:37427)
0812 11:21:14.304120 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:14.304124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:14.304920 (+ 796us) server_negotiation.cc:407] Connection header received
0812 11:21:14.306223 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:14.306227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:14.306285 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:14.306375 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:14.307498 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.308078 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.309553 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.309862 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.309955 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.312349 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:14.312353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:14.312354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:14.312379 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:14.313658 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.314222 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.314224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.314225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.314294 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.314641 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.314643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.314644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.314810 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:14.314884 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:14.315455 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 11:21:14.315554 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:21:14.316645 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.304341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:37427 (local address 127.12.175.194:35511)
0812 11:21:14.304777 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:14.304833 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:14.305995 (+ 1162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:14.306513 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:14.306520 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:14.306838 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:14.307382 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:14.307398 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.308217 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.308220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:14.309426 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:14.309449 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.309999 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.310002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:14.310142 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.310601 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:14.310616 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:14.312177 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:14.313774 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:14.313780 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:14.313795 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:14.314130 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:14.314369 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:14.314372 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:14.314374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:14.314554 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:14.314908 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:14.314914 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:14.315195 (+ 281us) client_negotiation.cc:769] Sending connection context
0812 11:21:14.315420 (+ 225us) client_negotiation.cc:240] Negotiation successful
0812 11:21:14.315728 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:21:14.317636 19249 heartbeater.cc:347] Connected to a master server at 127.12.175.254:37427
I20260812 11:21:14.317862 19249 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:14.318271 19249 heartbeater.cc:511] Master 127.12.175.254:37427 requested a full tablet report, sending...
I20260812 11:21:14.319167 18665 ts_manager.cc:194] Registered new tserver with Master: 2c9b95baadfb405db06818fa81af2337 (127.12.175.194:43707)
I20260812 11:21:14.319710 18665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:35511
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:14.333523 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37427
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:14.439252 19269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:14.439507 19269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:14.439563 19269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:14.443418 19269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:14.443464 19269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:14.443539 19269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:14.448446 19269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:14.449327 19269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:14.450222 19269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:14.459124 19276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:14.459098 19280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:14.459167 19269 server_base.cc:1034] running on GCE node
W20260812 11:21:14.459157 19283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:14.459821 19269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:14.460362 19269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:14.461527 19269 hybrid_clock.cc:648] HybridClock initialized: now 1786533674461507 us; error 31 us; skew 500 ppm
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:14.464118 19269 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:14.464881 19269 webserver.cc:460] Webserver started at http://127.12.175.195:33375/ using document root <none> and password file <none>
I20260812 11:21:14.465356 19269 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:14.465410 19269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:14.465567 19269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:14.467437 19269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "919d0cdd7c3c4036b5bf9973f3a05f84"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "26a9d27c7643d45948b7bf6e00695b4f"
server_key_iv: "1448d719f8c0c75f104f1ac1714b8ead"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.467926 19269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "919d0cdd7c3c4036b5bf9973f3a05f84"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "26a9d27c7643d45948b7bf6e00695b4f"
server_key_iv: "1448d719f8c0c75f104f1ac1714b8ead"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.471244 19269 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:14.473394 19293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.474535 19269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:14.474630 19269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "919d0cdd7c3c4036b5bf9973f3a05f84"
format_stamp: "Formatted at 2026-08-12 11:21:14 on dist-test-slave-gjrz"
server_key: "26a9d27c7643d45948b7bf6e00695b4f"
server_key_iv: "1448d719f8c0c75f104f1ac1714b8ead"
server_key_version: "encryptionkey@0"
I20260812 11:21:14.474725 19269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:14.494251 19269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:14.496984 19269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:14.497145 19269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:14.497646 19269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:14.498368 19269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:14.498410 19269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.498448 19269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:14.498479 19269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:14.506649 19269 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:43669
I20260812 11:21:14.506686 19528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:43669 every 8 connection(s)
I20260812 11:21:14.507432 19269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:14.508926 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19269
I20260812 11:21:14.509047 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:14.509294 12991 external_mini_cluster.cc:1428] Setting key 0c83f8565c69fe73629d95442a437165
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:14.519656 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.509064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:41995 (local address 127.12.175.254:37427)
0812 11:21:14.509640 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:14.509645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:14.509914 (+ 269us) server_negotiation.cc:407] Connection header received
0812 11:21:14.511164 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:14.511167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:14.511222 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:14.511326 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:14.512576 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.513086 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.514495 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.514719 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.514798 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.516980 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:14.516982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:14.516985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:14.517007 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:14.518076 (+ 1069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.518483 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.518485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.518487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.518551 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.518782 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.518784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.518785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.518937 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:14.519004 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:14.519443 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 11:21:14.519541 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480}
I20260812 11:21:14.520304 19533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.509327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:37427 (local address 127.12.175.195:41995)
0812 11:21:14.509779 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:14.509826 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:14.510993 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:14.511484 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:14.511492 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:14.511888 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:14.512454 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:14.512471 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.513195 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.513198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:14.514367 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:14.514380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.514835 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.514837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:14.514992 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.515496 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:14.515511 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:14.516828 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:14.518176 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:14.518181 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:14.518191 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:14.518413 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:14.518608 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:14.518610 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:14.518612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:14.518723 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:14.519003 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:14.519007 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:14.519206 (+ 199us) client_negotiation.cc:769] Sending connection context
0812 11:21:14.519389 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 11:21:14.519614 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":118,"threads_started":1}
I20260812 11:21:14.521248 19530 heartbeater.cc:347] Connected to a master server at 127.12.175.254:37427
I20260812 11:21:14.521463 19530 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:14.522001 19530 heartbeater.cc:511] Master 127.12.175.254:37427 requested a full tablet report, sending...
I20260812 11:21:14.522928 18665 ts_manager.cc:194] Registered new tserver with Master: 919d0cdd7c3c4036b5bf9973f3a05f84 (127.12.175.195:43669)
I20260812 11:21:14.523494 18665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:41995
I20260812 11:21:14.534063 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[18568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533674, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:14.557587 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:14.550621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51958 (local address 127.12.175.254:37427)
0812 11:21:14.550753 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:14.550757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:14.550877 (+ 120us) server_negotiation.cc:407] Connection header received
0812 11:21:14.550972 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:14.550974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:14.551012 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:14.551075 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:14.551715 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.552196 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.552954 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:14.553161 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:14.553234 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:14.555255 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:14.555258 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:14.555288 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:14.555309 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:14.556348 (+ 1039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.556686 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.556689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.556690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.556751 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:14.556924 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:14.556926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:14.556927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:14.557108 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:14.557202 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:14.557350 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 11:21:14.557444 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 11:21:14.557907 18665 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51958
I20260812 11:21:14.558576 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18784
I20260812 11:21:14.589049 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19018
I20260812 11:21:14.600723 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19269
I20260812 11:21:14.620080 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18599
2026-08-12T11:21:14Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2227 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[19555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[19555](info): set up 2 sockets
Aug 12 11:21:14 dist-test-slave-gjrz krb5kdc[19555](info): commencing operation
krb5kdc: starting...
W20260812 11:21:15.814059 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:15 dist-test-slave-gjrz krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:15.923866 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36421
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:36421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:16.028857 19581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:16.029088 19581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:16.029141 19581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:16.033020 19581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:16.033072 19581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:16.033099 19581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:16.033121 19581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:16.033149 19581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:16.038122 19581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:36421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:16.039017 19581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:16.039973 19581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:16.048012 19595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.048141 19592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.048066 19591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:16.048179 19581 server_base.cc:1034] running on GCE node
I20260812 11:21:16.048776 19581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:16.049754 19581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:16.050917 19581 hybrid_clock.cc:648] HybridClock initialized: now 1786533676050905 us; error 24 us; skew 500 ppm
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:16.053494 19581 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:16.054312 19581 webserver.cc:460] Webserver started at http://127.12.175.254:34491/ using document root <none> and password file <none>
I20260812 11:21:16.054816 19581 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:16.054880 19581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:16.055075 19581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:16.056991 19581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "c0f1ca498c5e405287acbac95a002875"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "5e98d8c6f1f4e8bc453302fe0b0ff919"
server_key_iv: "26cf11b74f40284a4446419c72f1d358"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.057502 19581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "c0f1ca498c5e405287acbac95a002875"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "5e98d8c6f1f4e8bc453302fe0b0ff919"
server_key_iv: "26cf11b74f40284a4446419c72f1d358"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.060953 19581 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:16.063084 19608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.064219 19581 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:16.064329 19581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "c0f1ca498c5e405287acbac95a002875"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "5e98d8c6f1f4e8bc453302fe0b0ff919"
server_key_iv: "26cf11b74f40284a4446419c72f1d358"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.064412 19581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:16.085731 19581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:16.088193 19581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:16.088375 19581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:16.094837 19581 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:36421
I20260812 11:21:16.094861 19714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:36421 every 8 connection(s)
I20260812 11:21:16.095677 19581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:16.098186 19718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:16.098637 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19581
I20260812 11:21:16.098753 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:16.098992 12991 external_mini_cluster.cc:1428] Setting key 74b2f2ecdbdec2966f1928d42125d333
I20260812 11:21:16.104581 19718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875: Bootstrap starting.
I20260812 11:21:16.107081 19718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875: Neither blocks nor log segments found. Creating new log.
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:16.107841 19718 log.cc:824] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:16.109514 19718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875: No bootstrap required, opened a new log
I20260812 11:21:16.112198 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.100181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55442 (local address 127.12.175.254:36421)
0812 11:21:16.100575 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:16.100589 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:16.100621 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:21:16.101257 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:16.101273 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:16.101575 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:16.101833 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:16.102819 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.103876 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.104991 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.105448 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.105568 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.108156 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:16.108162 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:16.108174 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:16.108200 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:16.109667 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.110067 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.110071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.110076 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.110182 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.110436 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.110439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.110441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.110793 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:16.110979 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:16.111257 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 11:21:16.111539 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":119,"threads_started":1}
I20260812 11:21:16.112838 19718 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f1ca498c5e405287acbac95a002875" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36421 } }
I20260812 11:21:16.113047 19718 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:16.113104 19718 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f1ca498c5e405287acbac95a002875, State: Initialized, Role: FOLLOWER
I20260812 11:21:16.113534 19718 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f1ca498c5e405287acbac95a002875" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36421 } }
I20260812 11:21:16.113696 19718 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:16.113757 19718 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:16.113849 19718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:16.114701 19718 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f1ca498c5e405287acbac95a002875" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36421 } }
I20260812 11:21:16.114981 19718 leader_election.cc:302] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0f1ca498c5e405287acbac95a002875; no voters:
I20260812 11:21:16.115206 19718 leader_election.cc:288] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:16.115336 19727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:16.115548 19727 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [term 1 LEADER]: Becoming Leader. State: Replica: c0f1ca498c5e405287acbac95a002875, State: Running, Role: LEADER
I20260812 11:21:16.115825 19727 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f1ca498c5e405287acbac95a002875" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36421 } }
I20260812 11:21:16.116261 19718 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:16.117338 19728 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0f1ca498c5e405287acbac95a002875" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f1ca498c5e405287acbac95a002875" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36421 } } }
I20260812 11:21:16.117340 19732 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0f1ca498c5e405287acbac95a002875. Latest consensus state: current_term: 1 leader_uuid: "c0f1ca498c5e405287acbac95a002875" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f1ca498c5e405287acbac95a002875" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36421 } } }
I20260812 11:21:16.117547 19732 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:16.117511 19728 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:16.118645 19746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:16.121541 19746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:16.126108 19746 catalog_manager.cc:1347] Generated new cluster ID: 99c25f779cb6483aab2730392a96b2ce
I20260812 11:21:16.126168 19746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:16.138923 19746 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:16.139986 19746 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:16.145284 19746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0f1ca498c5e405287acbac95a002875: Generated new TSK 0
I20260812 11:21:16.145825 19746 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:16.171676 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36421
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:16.278139 19768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:16.278353 19768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:16.278394 19768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:16.282259 19768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:16.282305 19768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:16.282371 19768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:16.287236 19768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:16.288120 19768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:16.289191 19768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:16.303781 19783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:16.303987 19768 server_base.cc:1034] running on GCE node
W20260812 11:21:16.303788 19776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.304314 19778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:16.304764 19768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:16.305416 19768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:16.306550 19768 hybrid_clock.cc:648] HybridClock initialized: now 1786533676306519 us; error 47 us; skew 500 ppm
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:16.309379 19768 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:16.311431 19768 webserver.cc:460] Webserver started at http://127.12.175.193:32939/ using document root <none> and password file <none>
I20260812 11:21:16.312044 19768 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:16.312134 19768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:16.312376 19768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:16.314857 19768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "7f3e27e643264f1fb20f3e39003532e0"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "a9d56f0115f7d5ce5eb31db9de1309c2"
server_key_iv: "25f6b9311557c90c069bab20c9693abf"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.315563 19768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "7f3e27e643264f1fb20f3e39003532e0"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "a9d56f0115f7d5ce5eb31db9de1309c2"
server_key_iv: "25f6b9311557c90c069bab20c9693abf"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.320547 19768 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260812 11:21:16.323572 19796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.325029 19768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:16.325160 19768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "7f3e27e643264f1fb20f3e39003532e0"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "a9d56f0115f7d5ce5eb31db9de1309c2"
server_key_iv: "25f6b9311557c90c069bab20c9693abf"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.325259 19768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:16.356637 19768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:16.359189 19768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:16.359369 19768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:16.359889 19768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:16.360649 19768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:16.360694 19768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.360745 19768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:16.360771 19768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.369024 19768 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:35479
I20260812 11:21:16.369059 20003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:35479 every 8 connection(s)
I20260812 11:21:16.369833 19768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:16.378139 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19768
I20260812 11:21:16.378253 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:16.378561 12991 external_mini_cluster.cc:1428] Setting key 83ff452b3fddffe474993793f43923e8
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:16.382727 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.371468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:43835 (local address 127.12.175.254:36421)
0812 11:21:16.371598 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:16.371603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:16.372377 (+ 774us) server_negotiation.cc:407] Connection header received
0812 11:21:16.373680 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:16.373684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:16.373740 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:16.373809 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:16.374981 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.375555 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.376665 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.376891 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.376980 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.379288 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:16.379293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:16.379296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:16.379322 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:16.380785 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.381317 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.381319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.381321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.381387 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.381698 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.381701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.381702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.381925 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:16.382018 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:16.382447 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 11:21:16.382573 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:21:16.383417 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.371822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:36421 (local address 127.12.175.193:43835)
0812 11:21:16.372238 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:16.372278 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:16.373465 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:16.373980 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:16.373987 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:16.374351 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:16.374835 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:16.374851 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.375670 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.375673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:16.376543 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:16.376554 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.377027 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.377031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:16.377197 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.377672 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:16.377687 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:16.379144 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:16.380895 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:16.380901 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:16.380915 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:16.381236 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:16.381454 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:16.381457 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:16.381459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:16.381624 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:16.382020 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:16.382025 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:16.382240 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 11:21:16.382383 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 11:21:16.382608 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":110,"threads_started":1}
I20260812 11:21:16.384621 20004 heartbeater.cc:347] Connected to a master server at 127.12.175.254:36421
I20260812 11:21:16.384828 20004 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:16.385257 20004 heartbeater.cc:511] Master 127.12.175.254:36421 requested a full tablet report, sending...
I20260812 11:21:16.386893 19635 ts_manager.cc:194] Registered new tserver with Master: 7f3e27e643264f1fb20f3e39003532e0 (127.12.175.193:35479)
I20260812 11:21:16.388437 19635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:43835
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:16.405239 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36421
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:16.510869 20011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:16.511076 20011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:16.511121 20011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:16.514976 20011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:16.515023 20011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:16.515091 20011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:16.520061 20011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:16.520907 20011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:16.521785 20011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:16.530603 20032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.530612 20028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.530612 20027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:16.530778 20011 server_base.cc:1034] running on GCE node
I20260812 11:21:16.531203 20011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:16.531761 20011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:16.532904 20011 hybrid_clock.cc:648] HybridClock initialized: now 1786533676532878 us; error 35 us; skew 500 ppm
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:16.535355 20011 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:16.536128 20011 webserver.cc:460] Webserver started at http://127.12.175.194:43109/ using document root <none> and password file <none>
I20260812 11:21:16.536604 20011 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:16.536661 20011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:16.536849 20011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:16.538656 20011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "0a1e1308e5b049c38561dc3f87e7815d"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "e1ae1714b24852a108983ea6fb19cd32"
server_key_iv: "f4bf0e56c754a87b95d5a110c94585f7"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.539160 20011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "0a1e1308e5b049c38561dc3f87e7815d"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "e1ae1714b24852a108983ea6fb19cd32"
server_key_iv: "f4bf0e56c754a87b95d5a110c94585f7"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.542460 20011 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:16.544617 20041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.545665 20011 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:16.545758 20011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "0a1e1308e5b049c38561dc3f87e7815d"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "e1ae1714b24852a108983ea6fb19cd32"
server_key_iv: "f4bf0e56c754a87b95d5a110c94585f7"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.545850 20011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:16.560128 20011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:16.562424 20011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:16.562572 20011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:16.563088 20011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:16.563819 20011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:16.563863 20011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.563901 20011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:16.563930 20011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.571945 20011 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:36205
I20260812 11:21:16.571971 20246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:36205 every 8 connection(s)
I20260812 11:21:16.572671 20011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:16.580425 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20011
I20260812 11:21:16.580559 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:16.580868 12991 external_mini_cluster.cc:1428] Setting key cb843d3e9862788b22b2148cd133e718
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:16.585259 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.574154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:56653 (local address 127.12.175.254:36421)
0812 11:21:16.574275 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:16.574278 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:16.575057 (+ 779us) server_negotiation.cc:407] Connection header received
0812 11:21:16.576364 (+ 1307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:16.576367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:16.576424 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:16.576498 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:16.577528 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.578055 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.579114 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.579391 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.579484 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.581895 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:16.581899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:16.581902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:16.581926 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:16.583184 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.583778 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.583780 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.583781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.583853 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.584256 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.584259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.584261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.584469 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:16.584559 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:16.584979 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 11:21:16.585106 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:21:16.585870 20250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.574446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:36421 (local address 127.12.175.194:56653)
0812 11:21:16.574925 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:16.574972 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:16.576172 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:16.576665 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:16.576673 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:16.576971 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:16.577392 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:16.577404 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.578171 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.578174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:16.578991 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:16.579000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.579525 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.579529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:16.579683 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.580099 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:16.580120 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:16.581729 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:16.583317 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:16.583324 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:16.583336 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:16.583692 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:16.583929 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:16.583932 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:16.583934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:16.584168 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:16.584562 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:16.584567 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:16.584760 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 11:21:16.584903 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 11:21:16.585129 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":117,"threads_started":1}
I20260812 11:21:16.587013 20247 heartbeater.cc:347] Connected to a master server at 127.12.175.254:36421
I20260812 11:21:16.587208 20247 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:16.587625 20247 heartbeater.cc:511] Master 127.12.175.254:36421 requested a full tablet report, sending...
I20260812 11:21:16.588562 19635 ts_manager.cc:194] Registered new tserver with Master: 0a1e1308e5b049c38561dc3f87e7815d (127.12.175.194:36205)
I20260812 11:21:16.589082 19635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:56653
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:16.606208 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36421
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:16.711737 20255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:16.711957 20255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:16.711997 20255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:16.715840 20255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:16.715885 20255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:16.715950 20255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:16.721093 20255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:16.721923 20255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:16.722750 20255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:16.731617 20264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.731626 20267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:16.731632 20262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:16.731920 20255 server_base.cc:1034] running on GCE node
I20260812 11:21:16.732278 20255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:16.732856 20255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:16.734004 20255 hybrid_clock.cc:648] HybridClock initialized: now 1786533676733984 us; error 42 us; skew 500 ppm
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:16.736536 20255 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:16.737301 20255 webserver.cc:460] Webserver started at http://127.12.175.195:44037/ using document root <none> and password file <none>
I20260812 11:21:16.737793 20255 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:16.737856 20255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:16.738046 20255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:16.739974 20255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "4fcc72c671f241219d6e115d07a5a7b0"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "0554ec5e99e9c4e91afebd1b47da8fdf"
server_key_iv: "01da4cf26bfee7f63be94693425b4925"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.740489 20255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "4fcc72c671f241219d6e115d07a5a7b0"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "0554ec5e99e9c4e91afebd1b47da8fdf"
server_key_iv: "01da4cf26bfee7f63be94693425b4925"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.743857 20255 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:16.746001 20279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.747076 20255 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:16.747175 20255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "4fcc72c671f241219d6e115d07a5a7b0"
format_stamp: "Formatted at 2026-08-12 11:21:16 on dist-test-slave-gjrz"
server_key: "0554ec5e99e9c4e91afebd1b47da8fdf"
server_key_iv: "01da4cf26bfee7f63be94693425b4925"
server_key_version: "encryptionkey@0"
I20260812 11:21:16.747280 20255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:16.761850 20255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:16.764576 20255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:16.764731 20255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:16.765237 20255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:16.765949 20255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:16.765995 20255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.766052 20255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:16.766080 20255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:16.775032 20255 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:45149
I20260812 11:21:16.775063 20502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:45149 every 8 connection(s)
I20260812 11:21:16.775851 20255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:16.781075 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20255
I20260812 11:21:16.781165 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:16.781399 12991 external_mini_cluster.cc:1428] Setting key 2f7ec674b3c3eec330d497316df0a5f5
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:16.788055 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.777481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:52855 (local address 127.12.175.254:36421)
0812 11:21:16.777616 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:16.777620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:16.778373 (+ 753us) server_negotiation.cc:407] Connection header received
0812 11:21:16.779642 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:16.779645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:16.779691 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:16.779753 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:16.780763 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.781329 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.782660 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.782894 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.782970 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.785271 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:16.785274 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:16.785276 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:16.785299 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:16.786505 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.786889 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.786891 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.786892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.786957 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.787195 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.787197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.787198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.787384 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:16.787456 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:16.787842 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 11:21:16.787929 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:21:16.788725 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.777817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:36421 (local address 127.12.175.195:52855)
0812 11:21:16.778239 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:16.778277 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:16.779450 (+ 1173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:16.779884 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:16.779890 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:16.780222 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:16.780653 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:16.780666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.781448 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.781452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:16.782559 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:16.782568 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.783030 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.783034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:16.783229 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.783745 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:16.783760 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:16.785135 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:16.786591 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:16.786596 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:16.786605 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:16.786819 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:16.787015 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:16.787017 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:16.787018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:16.787134 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:16.787466 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:16.787470 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:16.787670 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 11:21:16.787809 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 11:21:16.788020 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":106,"threads_started":1}
I20260812 11:21:16.789683 20504 heartbeater.cc:347] Connected to a master server at 127.12.175.254:36421
I20260812 11:21:16.789862 20504 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:16.790249 20504 heartbeater.cc:511] Master 127.12.175.254:36421 requested a full tablet report, sending...
I20260812 11:21:16.791109 19635 ts_manager.cc:194] Registered new tserver with Master: 4fcc72c671f241219d6e115d07a5a7b0 (127.12.175.195:45149)
I20260812 11:21:16.791652 19635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:52855
I20260812 11:21:16.794735 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:21:16.818941 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.810737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44672 (local address 127.12.175.193:35479)
0812 11:21:16.811069 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:16.811078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:16.811098 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:21:16.811141 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:16.811145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:16.811315 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:16.811436 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:16.812098 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.812829 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.813655 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.813990 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.814081 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.816118 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:16.816126 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:16.816137 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:16.816158 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:16.817573 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.817913 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.817917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.817918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.817987 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.818171 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.818173 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.818174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.818393 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:16.818530 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:16.818697 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:21:16.818805 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":147,"threads_started":1}
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[19555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:16.828601 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:16.821313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55444 (local address 127.12.175.254:36421)
0812 11:21:16.821421 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:16.821425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:16.821481 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:21:16.821615 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:16.821618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:16.821653 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:16.821709 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:16.822268 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.822752 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.823553 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:16.823755 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:16.823835 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:16.825847 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:16.825850 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:16.825852 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:16.825873 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:16.827054 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.827463 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.827467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.827468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.827539 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:16.827776 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:16.827779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:16.827781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:16.828010 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:16.828129 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:16.828364 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 11:21:16.828464 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 11:21:16.828910 19635 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55444
I20260812 11:21:16.829396 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19768
I20260812 11:21:16.845486 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20011
I20260812 11:21:16.871806 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20255
I20260812 11:21:16.878199 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19581
2026-08-12T11:21:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2255 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[20527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[20527](info): set up 2 sockets
Aug 12 11:21:16 dist-test-slave-gjrz krb5kdc[20527](info): commencing operation
krb5kdc: starting...
W20260812 11:21:18.060133 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:18.169945 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39595
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:18.275761 20559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:18.275980 20559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:18.276018 20559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:18.279902 20559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:18.279947 20559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:18.279965 20559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:18.279979 20559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:18.279994 20559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:18.284937 20559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:18.285784 20559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:18.286686 20559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:18.294260 20564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.294320 20559 server_base.cc:1034] running on GCE node
W20260812 11:21:18.294312 20567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.294275 20572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.294934 20559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:18.295943 20559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:18.297101 20559 hybrid_clock.cc:648] HybridClock initialized: now 1786533678297087 us; error 26 us; skew 500 ppm
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:18.305371 20559 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:18.305969 20559 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:18.306026 20559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:18.306172 20559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:18.308029 20559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "ddf3999a014a48a09e3a9a72f3378364"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "4f4e1399ccc7570e8368cecd52deb646"
server_key_iv: "ccc207f19561e3431bbfb9c8c8c87221"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.308492 20559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "ddf3999a014a48a09e3a9a72f3378364"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "4f4e1399ccc7570e8368cecd52deb646"
server_key_iv: "ccc207f19561e3431bbfb9c8c8c87221"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.311757 20559 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:18.313832 20589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.314934 20559 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:18.315047 20559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "ddf3999a014a48a09e3a9a72f3378364"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "4f4e1399ccc7570e8368cecd52deb646"
server_key_iv: "ccc207f19561e3431bbfb9c8c8c87221"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.315131 20559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:18.335057 20559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:18.337407 20559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:18.337572 20559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:18.343703 20559 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39595
I20260812 11:21:18.343919 20692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39595 every 8 connection(s)
I20260812 11:21:18.344265 20559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:18.344702 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20559
I20260812 11:21:18.344841 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:18.345081 12991 external_mini_cluster.cc:1428] Setting key 656439b3e6ed7d24a942e4e778f49c6c
I20260812 11:21:18.347077 20695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:18.353130 20695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364: Bootstrap starting.
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:18.355144 20695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:18.355829 20695 log.cc:824] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:18.357519 20695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364: No bootstrap required, opened a new log
I20260812 11:21:18.358069 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.346325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.12.175.254:39595)
0812 11:21:18.346712 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:18.346727 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:18.346760 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:21:18.347437 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:18.347456 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:18.347768 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:18.348025 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:18.348855 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.349797 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.350924 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.351410 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.351520 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.354019 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:18.354024 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:18.354038 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:18.354063 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:18.355554 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.355943 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.355948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.355952 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.356059 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.356312 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.356316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.356318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.356680 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:18.356842 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:18.357138 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:21:18.357385 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":116,"threads_started":1}
I20260812 11:21:18.361099 20695 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf3999a014a48a09e3a9a72f3378364" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39595 } }
I20260812 11:21:18.361292 20695 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:18.361348 20695 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf3999a014a48a09e3a9a72f3378364, State: Initialized, Role: FOLLOWER
I20260812 11:21:18.361706 20695 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf3999a014a48a09e3a9a72f3378364" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39595 } }
I20260812 11:21:18.361824 20695 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:18.361896 20695 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:18.361992 20695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:18.362737 20695 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf3999a014a48a09e3a9a72f3378364" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39595 } }
I20260812 11:21:18.363030 20695 leader_election.cc:302] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddf3999a014a48a09e3a9a72f3378364; no voters:
I20260812 11:21:18.363322 20695 leader_election.cc:288] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:18.363413 20705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:18.363610 20705 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [term 1 LEADER]: Becoming Leader. State: Replica: ddf3999a014a48a09e3a9a72f3378364, State: Running, Role: LEADER
I20260812 11:21:18.363891 20705 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf3999a014a48a09e3a9a72f3378364" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39595 } }
I20260812 11:21:18.364409 20695 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:18.365296 20706 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddf3999a014a48a09e3a9a72f3378364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf3999a014a48a09e3a9a72f3378364" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39595 } } }
I20260812 11:21:18.365417 20706 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:18.365684 20708 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddf3999a014a48a09e3a9a72f3378364. Latest consensus state: current_term: 1 leader_uuid: "ddf3999a014a48a09e3a9a72f3378364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf3999a014a48a09e3a9a72f3378364" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39595 } } }
I20260812 11:21:18.365783 20708 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:18.365871 20719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:18.368770 20719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:18.373628 20719 catalog_manager.cc:1347] Generated new cluster ID: 4db7c293adec4c62beca07687bb8ab2d
I20260812 11:21:18.373677 20719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:18.383162 20719 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:18.383960 20719 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:18.393481 20719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364: Generated new TSK 0
I20260812 11:21:18.394001 20719 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:18.428025 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39595
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:18.567512 20738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:18.567728 20738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:18.567768 20738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:18.571635 20738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:18.571679 20738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:18.571734 20738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:18.576612 20738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:18.577438 20738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:18.578349 20738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:18.586915 20749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.587039 20738 server_base.cc:1034] running on GCE node
W20260812 11:21:18.586902 20757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.586957 20750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.587572 20738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:18.588111 20738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:18.589282 20738 hybrid_clock.cc:648] HybridClock initialized: now 1786533678589266 us; error 31 us; skew 500 ppm
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:18.591840 20738 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:18.592516 20738 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:18.592583 20738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:18.592761 20738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:18.594595 20738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "ae599accafee4032a5f2a7d07f06acac"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "5389b8c5d35713ea52d7bfeb1001ae8e"
server_key_iv: "0e0bc38fe70a6bd3f3164c05fbb7c0d6"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.595111 20738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "ae599accafee4032a5f2a7d07f06acac"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "5389b8c5d35713ea52d7bfeb1001ae8e"
server_key_iv: "0e0bc38fe70a6bd3f3164c05fbb7c0d6"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.598416 20738 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260812 11:21:18.600571 20775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.601670 20738 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:18.601776 20738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "ae599accafee4032a5f2a7d07f06acac"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "5389b8c5d35713ea52d7bfeb1001ae8e"
server_key_iv: "0e0bc38fe70a6bd3f3164c05fbb7c0d6"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.601868 20738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:18.620126 20738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:18.622565 20738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:18.622723 20738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:18.623219 20738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:18.624002 20738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:18.624051 20738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.624100 20738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:18.624130 20738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.631975 20738 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:44029
I20260812 11:21:18.631995 21004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:44029 every 8 connection(s)
I20260812 11:21:18.632498 20738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:18.633941 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20738
I20260812 11:21:18.634076 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:18.634343 12991 external_mini_cluster.cc:1428] Setting key 79a392eff97d39c078fd95c13a2b84a4
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:18.646270 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.634011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:37377 (local address 127.12.175.254:39595)
0812 11:21:18.634157 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:18.634161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:18.635338 (+ 1177us) server_negotiation.cc:407] Connection header received
0812 11:21:18.636388 (+ 1050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:18.636391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:18.636433 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:18.636491 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:18.637864 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.638633 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.639995 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.640255 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.640337 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.642828 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:18.642832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:18.642835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:18.642862 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:18.644346 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.644822 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.644826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.644827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.644925 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.645270 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.645274 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.645275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.645451 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:18.645549 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:18.645984 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 11:21:18.646112 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:21:18.646956 21009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.634351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39595 (local address 127.12.175.193:37377)
0812 11:21:18.635205 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:18.635242 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:18.636152 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:18.636685 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:18.636694 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:18.637110 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:18.637710 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:18.637730 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.638758 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.638760 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:18.639854 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:18.639865 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.640403 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.640407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:18.640608 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.641173 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:18.641192 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:18.642665 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:18.644469 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:18.644473 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:18.644484 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:18.644723 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:18.645038 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:18.645040 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:18.645042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:18.645171 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:18.645552 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:18.645559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:18.645765 (+ 206us) client_negotiation.cc:769] Sending connection context
0812 11:21:18.645956 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 11:21:18.646259 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
I20260812 11:21:18.648066 21005 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39595
I20260812 11:21:18.648268 21005 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:18.648648 21005 heartbeater.cc:511] Master 127.12.175.254:39595 requested a full tablet report, sending...
I20260812 11:21:18.649997 20623 ts_manager.cc:194] Registered new tserver with Master: ae599accafee4032a5f2a7d07f06acac (127.12.175.193:44029)
I20260812 11:21:18.651070 20623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:37377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:18.661345 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39595
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:18.767244 21015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:18.767498 21015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:18.767557 21015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:18.771474 21015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:18.771523 21015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:18.771597 21015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:18.776541 21015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:18.777626 21015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:18.778815 21015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:18.787803 21025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.787865 21031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.787827 21024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.787886 21015 server_base.cc:1034] running on GCE node
I20260812 11:21:18.788399 21015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:18.788954 21015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:18.790102 21015 hybrid_clock.cc:648] HybridClock initialized: now 1786533678790078 us; error 36 us; skew 500 ppm
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:18.792671 21015 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:18.793293 21015 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:18.793351 21015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:18.793507 21015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:18.795311 21015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "564849b548994f3a864403a4d0508a17"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "4d8ea2d05016a71b693bd511caea4142"
server_key_iv: "d4e6fb14b5173914a0504e53747be1b8"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.795827 21015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "564849b548994f3a864403a4d0508a17"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "4d8ea2d05016a71b693bd511caea4142"
server_key_iv: "d4e6fb14b5173914a0504e53747be1b8"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.799099 21015 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:18.801288 21042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.802397 21015 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:18.802492 21015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "564849b548994f3a864403a4d0508a17"
format_stamp: "Formatted at 2026-08-12 11:21:18 on dist-test-slave-gjrz"
server_key: "4d8ea2d05016a71b693bd511caea4142"
server_key_iv: "d4e6fb14b5173914a0504e53747be1b8"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.802567 21015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:18.854049 21015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:18.856545 21015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:18.856699 21015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:18.857211 21015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:18.858050 21015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:18.858098 21015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.858147 21015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:18.858175 21015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.866178 21015 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:41969
I20260812 11:21:18.866200 21275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:41969 every 8 connection(s)
I20260812 11:21:18.866714 21015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
Aug 12 11:21:18 dist-test-slave-gjrz krb5kdc[20527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:18.876823 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21015
I20260812 11:21:18.876957 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:18.877223 12991 external_mini_cluster.cc:1428] Setting key 67a488fa7a3c8d314311ff3be0c06b68
I20260812 11:21:18.879083 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.868305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:33899 (local address 127.12.175.254:39595)
0812 11:21:18.868423 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:18.868427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:18.869567 (+ 1140us) server_negotiation.cc:407] Connection header received
0812 11:21:18.870379 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:18.870383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:18.870448 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:18.870517 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:18.871621 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.872135 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.873227 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.873457 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.873548 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.875703 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:18.875706 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:18.875708 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:18.875733 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:18.876939 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.877491 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.877495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.877497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.877588 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.877932 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.877935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.877936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.878129 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:18.878239 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:18.878825 (+ 586us) server_negotiation.cc:299] Negotiation successful
0812 11:21:18.878943 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:18.879758 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.868635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39595 (local address 127.12.175.194:33899)
0812 11:21:18.869439 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:18.869478 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:18.870193 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:18.870687 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:18.870694 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:18.871017 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:18.871485 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:18.871500 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.872249 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.872251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:18.873109 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:18.873119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.873591 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.873595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:18.873751 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.874193 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:18.874209 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:18.875553 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:18.877092 (+ 1539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:18.877097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:18.877108 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:18.877394 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:18.877681 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:18.877684 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:18.877686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:18.877814 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:18.878300 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:18.878306 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:18.878593 (+ 287us) client_negotiation.cc:769] Sending connection context
0812 11:21:18.878746 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 11:21:18.878984 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":104,"threads_started":1}
I20260812 11:21:18.880743 21276 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39595
I20260812 11:21:18.880978 21276 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:18.881420 21276 heartbeater.cc:511] Master 127.12.175.254:39595 requested a full tablet report, sending...
I20260812 11:21:18.882431 20623 ts_manager.cc:194] Registered new tserver with Master: 564849b548994f3a864403a4d0508a17 (127.12.175.194:41969)
I20260812 11:21:18.882980 20623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:33899
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:18.903178 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39595
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:19.009035 21285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:19.009243 21285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:19.009284 21285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:19.013156 21285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:19.013206 21285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:19.013264 21285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:19.018273 21285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:19.019227 21285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:19.020165 21285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:21:19.028880 21285 server_base.cc:1034] running on GCE node
W20260812 11:21:19.028820 21299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.028820 21296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.028831 21294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.029448 21285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:19.030036 21285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:19.031211 21285 hybrid_clock.cc:648] HybridClock initialized: now 1786533679031184 us; error 40 us; skew 500 ppm
Aug 12 11:21:19 dist-test-slave-gjrz krb5kdc[20527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533679, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:19.033815 21285 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:19.034499 21285 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:19.034566 21285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:19.034763 21285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:19.036779 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "c90d3f01d261426fa508a4547d3bbce8"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "16d7ae1b0ff4ed0a49d1adcb10379cd6"
server_key_iv: "a03ff3ee61cef6fb323f28bcb81e94c1"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.037317 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "c90d3f01d261426fa508a4547d3bbce8"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "16d7ae1b0ff4ed0a49d1adcb10379cd6"
server_key_iv: "a03ff3ee61cef6fb323f28bcb81e94c1"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.040897 21285 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:19.043206 21313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.044422 21285 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:19.044530 21285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "c90d3f01d261426fa508a4547d3bbce8"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "16d7ae1b0ff4ed0a49d1adcb10379cd6"
server_key_iv: "a03ff3ee61cef6fb323f28bcb81e94c1"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.044620 21285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:19.058913 21285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:19.061388 21285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:19.061545 21285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:19.062073 21285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:19.062830 21285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:19.062876 21285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.062924 21285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:19.062953 21285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.071175 21285 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:34245
I20260812 11:21:19.071228 21532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:34245 every 8 connection(s)
I20260812 11:21:19.071715 21285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:19.078614 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21285
I20260812 11:21:19.078758 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:19.079028 12991 external_mini_cluster.cc:1428] Setting key 3cfd843125dec72063fb87e13a1db6fc
Aug 12 11:21:19 dist-test-slave-gjrz krb5kdc[20527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533679, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:19.084334 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.073239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:46875 (local address 127.12.175.254:39595)
0812 11:21:19.073372 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.073377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.074466 (+ 1089us) server_negotiation.cc:407] Connection header received
0812 11:21:19.075287 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.075290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.075342 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.075406 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.076430 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.077035 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.078297 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.078560 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.078661 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.081205 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.081208 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.081211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.081239 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.082427 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.082896 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.082899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.082901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.082981 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.083309 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.083312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.083314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.083498 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.083587 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.084059 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.084179 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:21:19.085031 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.073601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39595 (local address 127.12.175.195:46875)
0812 11:21:19.074332 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.074369 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.075082 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.075562 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.075568 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.075887 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:19.076318 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.076331 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.077173 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.077176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.078178 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.078188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.078834 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.078839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.078989 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.079541 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:19.079560 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:19.081044 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:19.082545 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:19.082551 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:19.082565 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:19.082801 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:19.083073 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:19.083076 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:19.083079 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:19.083208 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:19.083599 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:19.083605 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:19.083831 (+ 226us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.083989 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.084285 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":103,"threads_started":1}
I20260812 11:21:19.086016 21533 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39595
I20260812 11:21:19.086230 21533 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:19.086625 21533 heartbeater.cc:511] Master 127.12.175.254:39595 requested a full tablet report, sending...
I20260812 11:21:19.087580 20623 ts_manager.cc:194] Registered new tserver with Master: c90d3f01d261426fa508a4547d3bbce8 (127.12.175.195:34245)
I20260812 11:21:19.088127 20623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:46875
I20260812 11:21:19.092705 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:21:19.100698 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.094535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36072 (local address 127.12.175.254:39595)
0812 11:21:19.094629 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.094632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.094809 (+ 177us) server_negotiation.cc:407] Connection header received
0812 11:21:19.094898 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.094899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.094932 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.094989 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.095635 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.096131 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.096858 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.097067 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.097133 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.098252 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.098255 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.098257 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.098277 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.099448 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.099795 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.099797 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.099799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.099860 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.100047 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.100049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.100050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.100253 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.100350 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.100517 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.100596 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 11:21:19.103209 20623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:19.106213 20623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:19.119845 21555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.113776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44029 (local address 127.0.0.1:51136)
0812 11:21:19.114319 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.114363 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.114479 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.115837 (+ 1358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.115841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.115860 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.115958 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.115963 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.117207 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.117211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.118344 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.118391 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.119314 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.119318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.119415 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.119457 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.119538 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.119711 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":219,"thread_start_us":74,"threads_started":1}
I20260812 11:21:19.119939 21566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.114515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48794 (local address 127.12.175.195:34245)
0812 11:21:19.114911 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.114923 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.114947 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:21:19.115008 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.115013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.115193 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.115347 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.115631 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.116760 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.118388 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.119100 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.119218 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.119376 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.119695 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.119790 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":136,"threads_started":1}
I20260812 11:21:19.120047 21560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.113902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.12.175.193:44029)
0812 11:21:19.115087 (+ 1185us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.115092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.115112 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:21:19.115173 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.115177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.115364 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.115863 (+ 499us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.116065 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.117064 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.118498 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.119162 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.119667 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.119783 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.119826 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.119900 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1080,"thread_start_us":74,"threads_started":1}
I20260812 11:21:19.120261 21564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.113886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34245 (local address 127.0.0.1:48794)
0812 11:21:19.114777 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.114789 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.114866 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.115349 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.115354 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.115376 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.115495 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.115502 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.116889 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.116893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.118267 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.118278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.119224 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.119229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.119359 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.119454 (+ 95us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.119566 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.120140 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"mutex_wait_us":500,"thread_start_us":81,"threads_started":1}
I20260812 11:21:19.120703 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.114109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41969 (local address 127.0.0.1:33446)
0812 11:21:19.115597 (+ 1488us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.115609 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.115691 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.116254 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.116256 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.116270 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.116328 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.116332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.117506 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.117509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.118718 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.118728 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.119958 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.119962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.120057 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.120214 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.120512 (+ 298us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.120586 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1404,"mutex_wait_us":124,"thread_start_us":101,"threads_started":1}
I20260812 11:21:19.121114 21565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.114515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33446 (local address 127.12.175.194:41969)
0812 11:21:19.115627 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.115641 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.115663 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:21:19.115795 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.115800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.115965 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.116121 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.116437 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.117360 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.118834 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.119667 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.119777 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.119892 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.120843 (+ 951us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.120948 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1012,"thread_start_us":115,"threads_started":1}
I20260812 11:21:19.123173 21410 tablet_service.cc:1467] Processing CreateTablet for tablet c3efa7a939064938b4197ddb811408db (DEFAULT_TABLE table=test-table [id=d613fb8b8fb848f08183ef81f072a34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:19.123179 20863 tablet_service.cc:1467] Processing CreateTablet for tablet c3efa7a939064938b4197ddb811408db (DEFAULT_TABLE table=test-table [id=d613fb8b8fb848f08183ef81f072a34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:19.124334 20863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3efa7a939064938b4197ddb811408db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.124339 21410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3efa7a939064938b4197ddb811408db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.125839 21132 tablet_service.cc:1467] Processing CreateTablet for tablet c3efa7a939064938b4197ddb811408db (DEFAULT_TABLE table=test-table [id=d613fb8b8fb848f08183ef81f072a34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:19.126636 21132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3efa7a939064938b4197ddb811408db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.131634 21568 tablet_bootstrap.cc:492] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Bootstrap starting.
I20260812 11:21:19.132059 21569 tablet_bootstrap.cc:492] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: Bootstrap starting.
I20260812 11:21:19.132889 21572 tablet_bootstrap.cc:492] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Bootstrap starting.
I20260812 11:21:19.134497 21569 tablet_bootstrap.cc:654] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.134552 21572 tablet_bootstrap.cc:654] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.134660 21568 tablet_bootstrap.cc:654] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.135679 21572 log.cc:824] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.135820 21568 log.cc:824] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.135846 21569 log.cc:824] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.137387 21572 tablet_bootstrap.cc:492] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: No bootstrap required, opened a new log
I20260812 11:21:19.137568 21572 ts_tablet_manager.cc:1397] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:21:19.137670 21569 tablet_bootstrap.cc:492] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: No bootstrap required, opened a new log
I20260812 11:21:19.137676 21568 tablet_bootstrap.cc:492] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: No bootstrap required, opened a new log
I20260812 11:21:19.137856 21568 ts_tablet_manager.cc:1397] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:21:19.137856 21569 ts_tablet_manager.cc:1397] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:21:19.140384 21572 raft_consensus.cc:348] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.140599 21572 raft_consensus.cc:374] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.140662 21572 raft_consensus.cc:729] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564849b548994f3a864403a4d0508a17, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.141063 21572 consensus_queue.cc:260] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.141490 21569 raft_consensus.cc:348] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.141490 21568 raft_consensus.cc:348] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.141731 21568 raft_consensus.cc:374] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.141731 21569 raft_consensus.cc:374] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.141780 21568 raft_consensus.cc:729] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c90d3f01d261426fa508a4547d3bbce8, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.141780 21569 raft_consensus.cc:729] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae599accafee4032a5f2a7d07f06acac, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.142117 21572 ts_tablet_manager.cc:1428] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20260812 11:21:19.142205 21568 consensus_queue.cc:260] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.142205 21569 consensus_queue.cc:260] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.142459 21276 heartbeater.cc:503] Master 127.12.175.254:39595 was elected leader, sending a full tablet report...
I20260812 11:21:19.143064 21533 heartbeater.cc:503] Master 127.12.175.254:39595 was elected leader, sending a full tablet report...
I20260812 11:21:19.143091 21005 heartbeater.cc:503] Master 127.12.175.254:39595 was elected leader, sending a full tablet report...
I20260812 11:21:19.143115 21568 ts_tablet_manager.cc:1428] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:21:19.143784 21569 ts_tablet_manager.cc:1428] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:21:19.200851 21582 raft_consensus.cc:482] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:19.201040 21582 raft_consensus.cc:504] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.202086 21582 leader_election.cc:288] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae599accafee4032a5f2a7d07f06acac (127.12.175.193:44029), c90d3f01d261426fa508a4547d3bbce8 (127.12.175.195:34245)
I20260812 11:21:19.205814 21566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.202596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:36415 (local address 127.12.175.195:34245)
0812 11:21:19.202714 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.202717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.202728 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:19.202768 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.202770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.202805 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.202868 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.203293 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.203801 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.204846 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.205305 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.205441 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.205499 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.205652 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.205715 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:21:19.205816 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.202284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34245 (local address 127.12.175.194:36415)
0812 11:21:19.202413 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.202430 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.202524 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.202899 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.202902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.202956 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.203119 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.203131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.203923 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.203927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.204721 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.204730 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.205413 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.205417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.205519 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.205542 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.205611 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.205684 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":3}
I20260812 11:21:19.205943 21560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.202441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:47025 (local address 127.12.175.193:44029)
0812 11:21:19.202578 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.202583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.202842 (+ 259us) server_negotiation.cc:407] Connection header received
0812 11:21:19.202951 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.202954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.202992 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.203059 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.203304 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.203797 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.204889 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.205393 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.205497 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.205546 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.205756 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.205825 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:19.205961 21586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.202288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44029 (local address 127.12.175.194:47025)
0812 11:21:19.202752 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.202763 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.202857 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.203068 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.203071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.203085 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.203188 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.203193 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.203896 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.203899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.204777 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.204787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.205544 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.205547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.205645 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.205669 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.205739 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.205837 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":53,"thread_start_us":117,"threads_started":1}
I20260812 11:21:19.206553 20911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3efa7a939064938b4197ddb811408db" candidate_uuid: "564849b548994f3a864403a4d0508a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae599accafee4032a5f2a7d07f06acac" is_pre_election: true
I20260812 11:21:19.206669 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3efa7a939064938b4197ddb811408db" candidate_uuid: "564849b548994f3a864403a4d0508a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c90d3f01d261426fa508a4547d3bbce8" is_pre_election: true
I20260812 11:21:19.206851 20911 raft_consensus.cc:2454] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 564849b548994f3a864403a4d0508a17 in term 0.
I20260812 11:21:19.206977 21447 raft_consensus.cc:2454] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 564849b548994f3a864403a4d0508a17 in term 0.
I20260812 11:21:19.207317 21046 leader_election.cc:302] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 564849b548994f3a864403a4d0508a17, ae599accafee4032a5f2a7d07f06acac; no voters:
I20260812 11:21:19.207554 21582 raft_consensus.cc:2781] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:19.207635 21582 raft_consensus.cc:482] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:19.207685 21582 raft_consensus.cc:3037] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.208691 21582 raft_consensus.cc:504] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.208993 21582 leader_election.cc:288] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [CANDIDATE]: Term 1 election: Requested vote from peers ae599accafee4032a5f2a7d07f06acac (127.12.175.193:44029), c90d3f01d261426fa508a4547d3bbce8 (127.12.175.195:34245)
I20260812 11:21:19.209270 20911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3efa7a939064938b4197ddb811408db" candidate_uuid: "564849b548994f3a864403a4d0508a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae599accafee4032a5f2a7d07f06acac"
I20260812 11:21:19.209317 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3efa7a939064938b4197ddb811408db" candidate_uuid: "564849b548994f3a864403a4d0508a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c90d3f01d261426fa508a4547d3bbce8"
I20260812 11:21:19.209367 20911 raft_consensus.cc:3037] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.209429 21447 raft_consensus.cc:3037] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.210322 20911 raft_consensus.cc:2454] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 564849b548994f3a864403a4d0508a17 in term 1.
I20260812 11:21:19.210412 21447 raft_consensus.cc:2454] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 564849b548994f3a864403a4d0508a17 in term 1.
I20260812 11:21:19.210595 21046 leader_election.cc:302] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 564849b548994f3a864403a4d0508a17, ae599accafee4032a5f2a7d07f06acac; no voters:
I20260812 11:21:19.210824 21582 raft_consensus.cc:2781] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:19.211041 21582 raft_consensus.cc:686] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 1 LEADER]: Becoming Leader. State: Replica: 564849b548994f3a864403a4d0508a17, State: Running, Role: LEADER
I20260812 11:21:19.211360 21582 consensus_queue.cc:237] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } }
I20260812 11:21:19.214102 20621 catalog_manager.cc:5495] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 564849b548994f3a864403a4d0508a17 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "564849b548994f3a864403a4d0508a17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "564849b548994f3a864403a4d0508a17" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260812 11:21:19.237864 21565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.234574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33462 (local address 127.12.175.194:41969)
0812 11:21:19.234678 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.234683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.234695 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:19.234840 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.234842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.234888 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.234971 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:19.235218 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.235727 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.236549 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.236755 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.236838 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.237129 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:19.237484 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:19.237598 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.237673 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.237725 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:21:19.242858 20911 raft_consensus.cc:1261] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac [term 1 FOLLOWER]: Refusing update from remote peer 564849b548994f3a864403a4d0508a17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:19.242858 21447 raft_consensus.cc:1261] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 1 FOLLOWER]: Refusing update from remote peer 564849b548994f3a864403a4d0508a17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:19.243489 21587 consensus_queue.cc:1035] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae599accafee4032a5f2a7d07f06acac" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:19.243649 21582 consensus_queue.cc:1035] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c90d3f01d261426fa508a4547d3bbce8" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:19.250780 21591 mvcc.cc:205] Tried to move back new op lower bound from 7317641950172884992 to 7317641950052093952. Current Snapshot: MvccSnapshot[applied={T|T < 7317641950172884992}]
I20260812 11:21:19.253594 21600 mvcc.cc:205] Tried to move back new op lower bound from 7317641950172884992 to 7317641950052093952. Current Snapshot: MvccSnapshot[applied={T|T < 7317641950172884992 or (T in {7317641950172884992})}]
I20260812 11:21:19.260294 20621 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:19.260423 20621 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:19.262576 20621 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddf3999a014a48a09e3a9a72f3378364: Sending DeleteTablet for 3 replicas of tablet c3efa7a939064938b4197ddb811408db
I20260812 11:21:19.263324 20863 tablet_service.cc:1514] Processing DeleteTablet for tablet c3efa7a939064938b4197ddb811408db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:19 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:51136
I20260812 11:21:19.263306 21410 tablet_service.cc:1514] Processing DeleteTablet for tablet c3efa7a939064938b4197ddb811408db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:19 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:48794
I20260812 11:21:19.263439 21132 tablet_service.cc:1514] Processing DeleteTablet for tablet c3efa7a939064938b4197ddb811408db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:19 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:33446
I20260812 11:21:19.263872 21621 tablet_replica.cc:330] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: stopping tablet replica
I20260812 11:21:19.264181 21619 tablet_replica.cc:330] T c3efa7a939064938b4197ddb811408db P ae599accafee4032a5f2a7d07f06acac: stopping tablet replica
I20260812 11:21:19.264344 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20738
I20260812 11:21:19.267685 21621 raft_consensus.cc:2229] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:19.268128 21621 raft_consensus.cc:2258] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:19.273953 21621 ts_tablet_manager.cc:1905] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:19.282204 21621 ts_tablet_manager.cc:1918] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:19.282223 21618 tablet_replica.cc:330] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: stopping tablet replica
I20260812 11:21:19.282310 21621 log.cc:1196] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/c3efa7a939064938b4197ddb811408db
I20260812 11:21:19.282552 21618 raft_consensus.cc:2229] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:19.282644 21621 ts_tablet_manager.cc:1939] T c3efa7a939064938b4197ddb811408db P 564849b548994f3a864403a4d0508a17: Deleting consensus metadata
I20260812 11:21:19.282893 21618 raft_consensus.cc:2258] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:19.283859 20593 catalog_manager.cc:4841] TS 564849b548994f3a864403a4d0508a17 (127.12.175.194:41969): tablet c3efa7a939064938b4197ddb811408db (table test-table [id=d613fb8b8fb848f08183ef81f072a34c]) successfully deleted
I20260812 11:21:19.284394 21618 ts_tablet_manager.cc:1905] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:19.286394 21618 ts_tablet_manager.cc:1918] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:19.286478 21618 log.cc:1196] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/c3efa7a939064938b4197ddb811408db
I20260812 11:21:19.286737 21618 ts_tablet_manager.cc:1939] T c3efa7a939064938b4197ddb811408db P c90d3f01d261426fa508a4547d3bbce8: Deleting consensus metadata
I20260812 11:21:19.287747 20591 catalog_manager.cc:4841] TS c90d3f01d261426fa508a4547d3bbce8 (127.12.175.195:34245): tablet c3efa7a939064938b4197ddb811408db (table test-table [id=d613fb8b8fb848f08183ef81f072a34c]) successfully deleted
W20260812 11:21:19.289108 20592 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:44029 (error 108)
I20260812 11:21:19.289911 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21015
I20260812 11:21:19.290105 21564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.289773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44029 (local address 127.0.0.1:51150)
0812 11:21:19.289938 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.290006 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:44029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260812 11:21:19.297920 20592 catalog_manager.cc:4584] TS ae599accafee4032a5f2a7d07f06acac (127.12.175.193:44029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3efa7a939064938b4197ddb811408db: Network error: Client connection negotiation failed: client connection to 127.12.175.193:44029: connect: Connection refused (error 111)
I20260812 11:21:19.310607 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21285
I20260812 11:21:19.320298 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20559
2026-08-12T11:21:19Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2444 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T11:21:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:19Z Disabled control of system clock
I20260812 11:21:19.356980 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:40695
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:34733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:40695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:21:19.461371 21630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:19.461586 21630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:19.461620 21630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:19.465462 21630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:19.465507 21630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:19.465520 21630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:19.465538 21630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:19.465566 21630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:19.470077 21630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:40695
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:40695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:19.470933 21630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:19.472191 21630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:19.479921 21642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.479923 21640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.479995 21637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.480080 21630 server_base.cc:1034] running on GCE node
I20260812 11:21:19.480683 21630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:19.481693 21630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:19.482858 21630 hybrid_clock.cc:648] HybridClock initialized: now 1786533679482825 us; error 41 us; skew 500 ppm
I20260812 11:21:19.484579 21630 webserver.cc:460] Webserver started at http://127.12.175.254:39399/ using document root <none> and password file <none>
I20260812 11:21:19.485087 21630 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:19.485152 21630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:19.485334 21630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:19.487182 21630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "fc4db4259cf14c5a8289844cc6c0784e"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "eede57b7057b4059f44e14882a54e942"
server_key_iv: "e6320f64ffc0ac02cf16d90c07dcf621"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.487722 21630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "fc4db4259cf14c5a8289844cc6c0784e"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "eede57b7057b4059f44e14882a54e942"
server_key_iv: "e6320f64ffc0ac02cf16d90c07dcf621"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.491076 21630 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:19.493364 21660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.494719 21630 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:19.494834 21630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "fc4db4259cf14c5a8289844cc6c0784e"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "eede57b7057b4059f44e14882a54e942"
server_key_iv: "e6320f64ffc0ac02cf16d90c07dcf621"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.494943 21630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:19.500597 21630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:19.501120 21630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:19.501271 21630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:19.507398 21630 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:40695
I20260812 11:21:19.507431 21768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:40695 every 8 connection(s)
I20260812 11:21:19.508231 21630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:19.511046 21769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.511700 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21630
I20260812 11:21:19.511795 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:19.512032 12991 external_mini_cluster.cc:1428] Setting key c4f47d9d2f516a73de643ea2007ec368
I20260812 11:21:19.516690 21769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e: Bootstrap starting.
I20260812 11:21:19.517166 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.513341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50124 (local address 127.12.175.254:40695)
0812 11:21:19.513942 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.513957 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.513990 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:21:19.514592 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.514606 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.514929 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.515176 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.515989 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.515994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.516005 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:19.516015 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.516065 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:19.516081 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.516178 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.516292 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.516506 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":121,"threads_started":1}
I20260812 11:21:19.518842 21769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.519630 21769 log.cc:824] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.521224 21769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e: No bootstrap required, opened a new log
I20260812 11:21:19.524648 21769 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4db4259cf14c5a8289844cc6c0784e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40695 } }
I20260812 11:21:19.524886 21769 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.524956 21769 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc4db4259cf14c5a8289844cc6c0784e, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.525339 21769 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4db4259cf14c5a8289844cc6c0784e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40695 } }
I20260812 11:21:19.525454 21769 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:19.525496 21769 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:19.525563 21769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.526268 21769 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4db4259cf14c5a8289844cc6c0784e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40695 } }
I20260812 11:21:19.526539 21769 leader_election.cc:302] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc4db4259cf14c5a8289844cc6c0784e; no voters:
I20260812 11:21:19.526760 21769 leader_election.cc:288] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:19.526868 21776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:19.527062 21776 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [term 1 LEADER]: Becoming Leader. State: Replica: fc4db4259cf14c5a8289844cc6c0784e, State: Running, Role: LEADER
I20260812 11:21:19.527369 21776 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4db4259cf14c5a8289844cc6c0784e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40695 } }
I20260812 11:21:19.527824 21769 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:19.528852 21780 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc4db4259cf14c5a8289844cc6c0784e. Latest consensus state: current_term: 1 leader_uuid: "fc4db4259cf14c5a8289844cc6c0784e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4db4259cf14c5a8289844cc6c0784e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40695 } } }
I20260812 11:21:19.528971 21780 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:19.529264 21779 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc4db4259cf14c5a8289844cc6c0784e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4db4259cf14c5a8289844cc6c0784e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40695 } } }
I20260812 11:21:19.529356 21779 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:19.529525 21798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:19.532179 21798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:19.536543 21798 catalog_manager.cc:1347] Generated new cluster ID: 6c1bbe951f76423590ba275d149691f9
I20260812 11:21:19.536607 21798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:19.544826 21798 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:19.545102 21798 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:19.550187 21798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e: Generated new TSK 0
I20260812 11:21:19.550697 21798 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:19.553896 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40695
--builtin_ntp_servers=127.12.175.212:34733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:21:19.660118 21824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:19.660331 21824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:19.660368 21824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:19.664223 21824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:19.664266 21824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:19.664326 21824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:19.668857 21824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:19.669752 21824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:19.670984 21824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:19.680032 21833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.680037 21838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.680099 21824 server_base.cc:1034] running on GCE node
W20260812 11:21:19.680028 21835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.680610 21824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:19.681126 21824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:19.682279 21824 hybrid_clock.cc:648] HybridClock initialized: now 1786533679682260 us; error 27 us; skew 500 ppm
I20260812 11:21:19.683997 21824 webserver.cc:460] Webserver started at http://127.12.175.193:37615/ using document root <none> and password file <none>
I20260812 11:21:19.684527 21824 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:19.684587 21824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:19.684778 21824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:19.686757 21824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "b2f74896226344638ceff4e679aed330"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "67b9205d19fc9071f2ccd34733a4a76c"
server_key_iv: "855b6c62d14ec262768b9bf902111e2b"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.687315 21824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "b2f74896226344638ceff4e679aed330"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "67b9205d19fc9071f2ccd34733a4a76c"
server_key_iv: "855b6c62d14ec262768b9bf902111e2b"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.690688 21824 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:19.693001 21848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.694096 21824 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:21:19.694195 21824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "b2f74896226344638ceff4e679aed330"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "67b9205d19fc9071f2ccd34733a4a76c"
server_key_iv: "855b6c62d14ec262768b9bf902111e2b"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.694289 21824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:19.698436 21824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:19.698958 21824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:19.699100 21824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:19.699609 21824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:19.700462 21824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:19.700508 21824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.700555 21824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:19.700583 21824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.708424 21824 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:39645
I20260812 11:21:19.708451 22111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:39645 every 8 connection(s)
I20260812 11:21:19.709219 21824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:19.709899 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21824
I20260812 11:21:19.710016 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:19.710271 12991 external_mini_cluster.cc:1428] Setting key 4d930a7733d6ba5bd8e6f96d198e8d46
I20260812 11:21:19.712081 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40695
--builtin_ntp_servers=127.12.175.212:34733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:21:19.714972 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.711449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:43169 (local address 127.12.175.254:40695)
0812 11:21:19.711572 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.711576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.712127 (+ 551us) server_negotiation.cc:407] Connection header received
0812 11:21:19.713343 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.713346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.713387 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.713483 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.714590 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.714593 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.714595 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:19.714606 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.714625 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:19.714632 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.714698 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.714839 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.714872 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:19.715972 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.711218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40695 (local address 127.12.175.193:43169)
0812 11:21:19.711964 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.712010 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.713146 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.713691 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.713699 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.713807 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:19.714307 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:19.714309 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:19.714359 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:19.714442 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:19.714709 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:19.714717 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:19.714723 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.714882 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.715105 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":130,"threads_started":1}
I20260812 11:21:19.717064 22113 heartbeater.cc:347] Connected to a master server at 127.12.175.254:40695
I20260812 11:21:19.717259 22113 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:19.717603 22113 heartbeater.cc:511] Master 127.12.175.254:40695 requested a full tablet report, sending...
I20260812 11:21:19.718946 21703 ts_manager.cc:194] Registered new tserver with Master: b2f74896226344638ceff4e679aed330 (127.12.175.193:39645)
W20260812 11:21:19.819562 22117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:19.819766 22117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:19.819818 22117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:19.823673 22117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:19.823716 22117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:19.823787 22117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:19.828246 22117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:19.829111 22117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:19.830303 22117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:19.839018 22132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.839025 22135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.839054 22117 server_base.cc:1034] running on GCE node
W20260812 11:21:19.839046 22129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.839597 22117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:19.840107 22117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:19.841246 22117 hybrid_clock.cc:648] HybridClock initialized: now 1786533679841225 us; error 35 us; skew 500 ppm
I20260812 11:21:19.842811 22117 webserver.cc:460] Webserver started at http://127.12.175.194:41609/ using document root <none> and password file <none>
I20260812 11:21:19.843344 22117 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:19.843408 22117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:19.843564 22117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:19.845337 22117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "71f86b00237340668d764d46e319a9f4"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "f9ec3366a58e4e48bc027e3ce5b81ee8"
server_key_iv: "4d484599fe5e8792c25b452971f79e13"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.845789 22117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "71f86b00237340668d764d46e319a9f4"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "f9ec3366a58e4e48bc027e3ce5b81ee8"
server_key_iv: "4d484599fe5e8792c25b452971f79e13"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.849068 22117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:19.851217 22144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.852300 22117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:19.852396 22117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "71f86b00237340668d764d46e319a9f4"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "f9ec3366a58e4e48bc027e3ce5b81ee8"
server_key_iv: "4d484599fe5e8792c25b452971f79e13"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.852473 22117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:19.856451 22117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:19.856927 22117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:19.857057 22117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:19.857481 22117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:19.858237 22117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:19.858279 22117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.858312 22117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:19.858332 22117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.866153 22117 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:42419
I20260812 11:21:19.866179 22370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:42419 every 8 connection(s)
I20260812 11:21:19.866868 22117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:19.868640 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22117
I20260812 11:21:19.868749 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:19.869007 12991 external_mini_cluster.cc:1428] Setting key d3c6194c8fa4646296285416cf9234c2
I20260812 11:21:19.870784 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40695
--builtin_ntp_servers=127.12.175.212:34733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:21:19.872383 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.868450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:33925 (local address 127.12.175.254:40695)
0812 11:21:19.868602 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.868607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.869587 (+ 980us) server_negotiation.cc:407] Connection header received
0812 11:21:19.870787 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.870791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.870834 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.870933 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.871983 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.871986 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.871989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:19.872003 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.872027 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:19.872038 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.872129 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.872214 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.872253 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:21:19.873266 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.868767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40695 (local address 127.12.175.194:33925)
0812 11:21:19.869439 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.869487 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.870594 (+ 1107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.871143 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.871149 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.871230 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:19.871742 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:19.871744 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:19.871779 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:19.871841 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:19.872113 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:19.872117 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:19.872121 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.872229 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.872420 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":113,"threads_started":1}
I20260812 11:21:19.874284 22372 heartbeater.cc:347] Connected to a master server at 127.12.175.254:40695
I20260812 11:21:19.874481 22372 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:19.874868 22372 heartbeater.cc:511] Master 127.12.175.254:40695 requested a full tablet report, sending...
I20260812 11:21:19.875924 21703 ts_manager.cc:194] Registered new tserver with Master: 71f86b00237340668d764d46e319a9f4 (127.12.175.194:42419)
W20260812 11:21:19.979440 22377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:19.979646 22377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:19.979681 22377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:19.983615 22377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:19.983657 22377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:19.983707 22377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:19.988181 22377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:40695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:19.988989 22377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:19.990123 22377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:19.998987 22388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.999020 22395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.999020 22389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.999185 22377 server_base.cc:1034] running on GCE node
I20260812 11:21:19.999593 22377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:20.000141 22377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:20.001294 22377 hybrid_clock.cc:648] HybridClock initialized: now 1786533680001280 us; error 24 us; skew 500 ppm
I20260812 11:21:20.002864 22377 webserver.cc:460] Webserver started at http://127.12.175.195:44669/ using document root <none> and password file <none>
I20260812 11:21:20.003422 22377 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:20.003487 22377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:20.003684 22377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:20.005491 22377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "34633693499b44c09ce2004af497fc7c"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "1a5e7b6b36036710e8270c01041c25c9"
server_key_iv: "3f82ad951d858d73a215d31a82b95845"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.005998 22377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "34633693499b44c09ce2004af497fc7c"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "1a5e7b6b36036710e8270c01041c25c9"
server_key_iv: "3f82ad951d858d73a215d31a82b95845"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.009397 22377 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:21:20.011657 22411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:20.012718 22377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:20.012816 22377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "34633693499b44c09ce2004af497fc7c"
format_stamp: "Formatted at 2026-08-12 11:21:19 on dist-test-slave-gjrz"
server_key: "1a5e7b6b36036710e8270c01041c25c9"
server_key_iv: "3f82ad951d858d73a215d31a82b95845"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.012902 22377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:20.017127 22377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:20.017648 22377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:20.017791 22377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:20.018251 22377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:20.019035 22377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:20.019080 22377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:20.019126 22377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:20.019152 22377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:20.026878 22377 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:37759
I20260812 11:21:20.026901 22646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:37759 every 8 connection(s)
I20260812 11:21:20.027644 22377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:20.028563 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22377
I20260812 11:21:20.028672 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:20.028949 12991 external_mini_cluster.cc:1428] Setting key 307451411c294d3ac20d262b2e360fe3
I20260812 11:21:20.033389 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.029417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:58345 (local address 127.12.175.254:40695)
0812 11:21:20.029540 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.029545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.030647 (+ 1102us) server_negotiation.cc:407] Connection header received
0812 11:21:20.031971 (+ 1324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.031974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.032015 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.032083 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.032976 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.032980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.032983 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.032995 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.033017 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.033025 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.033094 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.033229 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.033271 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:21:20.034108 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.029875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40695 (local address 127.12.175.195:58345)
0812 11:21:20.030529 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.030565 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.031784 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.032228 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.032234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.032313 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:20.032744 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:20.032745 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:20.032778 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:20.032845 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:20.033093 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:20.033101 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:20.033107 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:21:20.033256 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 11:21:20.033496 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":114,"threads_started":1}
I20260812 11:21:20.035013 22647 heartbeater.cc:347] Connected to a master server at 127.12.175.254:40695
I20260812 11:21:20.035182 22647 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:20.035553 22647 heartbeater.cc:511] Master 127.12.175.254:40695 requested a full tablet report, sending...
I20260812 11:21:20.036425 21703 ts_manager.cc:194] Registered new tserver with Master: 34633693499b44c09ce2004af497fc7c (127.12.175.195:37759)
I20260812 11:21:20.042604 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:21:20.045843 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.044391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45490 (local address 127.12.175.254:40695)
0812 11:21:20.044512 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.044516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.044694 (+ 178us) server_negotiation.cc:407] Connection header received
0812 11:21:20.044819 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.044823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.044855 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.044917 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.045500 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.045503 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.045506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.045519 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.045537 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.045545 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.045614 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.045689 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.045729 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:20.048290 21703 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45490:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:20.051167 21703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:20.062036 22672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.059525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:37759 (local address 127.0.0.1:49582)
0812 11:21:20.059754 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.059767 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.059839 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.060660 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.060663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.060679 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:20.061368 (+ 689us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:20.061370 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:20.061381 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:20.061406 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:20.061713 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:20.061715 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:20.061718 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 11:21:20.061816 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 11:21:20.061905 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":84,"threads_started":1}
I20260812 11:21:20.062176 22671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.059178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42419 (local address 127.0.0.1:34890)
0812 11:21:20.059443 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.059456 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.059532 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.060544 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.060550 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.060624 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:20.061211 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:20.061213 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:20.061232 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:20.061297 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:20.061694 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:20.061704 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:20.061710 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:21:20.062045 (+ 335us) client_negotiation.cc:240] Negotiation successful
0812 11:21:20.062079 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":125,"threads_started":1}
I20260812 11:21:20.062422 22674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.059903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49582 (local address 127.12.175.195:37759)
0812 11:21:20.060298 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.060306 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.060323 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:21:20.060361 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.060364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.060522 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.060651 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.061507 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.061512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.061521 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.061533 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.061567 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.061595 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.061676 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.062210 (+ 534us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.062287 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":132,"threads_started":1}
I20260812 11:21:20.062820 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.058835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39645 (local address 127.0.0.1:48018)
0812 11:21:20.059293 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.059342 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.059438 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.061578 (+ 2140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.061581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.061594 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:20.061985 (+ 391us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:20.061987 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:20.061997 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:20.062024 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:20.062588 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:20.062591 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:20.062595 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:21:20.062676 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:21:20.062710 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":63,"threads_started":1}
I20260812 11:21:20.063061 22670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.059017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48018 (local address 127.12.175.193:39645)
0812 11:21:20.061249 (+ 2232us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.061258 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.061275 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:21:20.061319 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.061324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.061479 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.061597 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.062317 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.062323 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.062334 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.062345 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.062384 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.062411 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.062614 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.062702 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.062769 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2127,"thread_start_us":92,"threads_started":1}
I20260812 11:21:20.063463 22673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.059720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34890 (local address 127.12.175.194:42419)
0812 11:21:20.060146 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.060158 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.060184 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:21:20.060235 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.060240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.060400 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.060502 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.061437 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.061444 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.061456 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.061469 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.061514 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.061545 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.061647 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.062397 (+ 750us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.062465 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":144,"threads_started":1}
I20260812 11:21:20.065389 22515 tablet_service.cc:1467] Processing CreateTablet for tablet 4886db48019d440baba1214fa016695f (DEFAULT_TABLE table=test-table [id=5e11752bf24b4755a9ce2a8e30bb4f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:20.065575 22245 tablet_service.cc:1467] Processing CreateTablet for tablet 4886db48019d440baba1214fa016695f (DEFAULT_TABLE table=test-table [id=5e11752bf24b4755a9ce2a8e30bb4f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:20.065840 21982 tablet_service.cc:1467] Processing CreateTablet for tablet 4886db48019d440baba1214fa016695f (DEFAULT_TABLE table=test-table [id=5e11752bf24b4755a9ce2a8e30bb4f35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:20.066530 22515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4886db48019d440baba1214fa016695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:20.066542 22245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4886db48019d440baba1214fa016695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:20.066746 21982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4886db48019d440baba1214fa016695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:20.072306 22675 tablet_bootstrap.cc:492] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Bootstrap starting.
I20260812 11:21:20.074106 22680 tablet_bootstrap.cc:492] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: Bootstrap starting.
I20260812 11:21:20.074609 22675 tablet_bootstrap.cc:654] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:20.073581 22678 tablet_bootstrap.cc:492] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Bootstrap starting.
I20260812 11:21:20.075510 22675 log.cc:824] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:20.076155 22680 tablet_bootstrap.cc:654] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:20.076984 22680 log.cc:824] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:20.077167 22678 tablet_bootstrap.cc:654] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:20.077618 22675 tablet_bootstrap.cc:492] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: No bootstrap required, opened a new log
I20260812 11:21:20.077804 22675 ts_tablet_manager.cc:1397] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:21:20.077956 22678 log.cc:824] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:20.078979 22680 tablet_bootstrap.cc:492] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: No bootstrap required, opened a new log
I20260812 11:21:20.079159 22680 ts_tablet_manager.cc:1397] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:21:20.079545 22678 tablet_bootstrap.cc:492] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: No bootstrap required, opened a new log
I20260812 11:21:20.079720 22678 ts_tablet_manager.cc:1397] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:21:20.082368 22675 raft_consensus.cc:348] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.082623 22675 raft_consensus.cc:374] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:20.082713 22675 raft_consensus.cc:729] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71f86b00237340668d764d46e319a9f4, State: Initialized, Role: FOLLOWER
I20260812 11:21:20.083177 22675 consensus_queue.cc:260] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.083515 22678 raft_consensus.cc:348] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.083518 22680 raft_consensus.cc:348] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.083753 22680 raft_consensus.cc:374] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:20.083798 22678 raft_consensus.cc:374] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:20.083811 22680 raft_consensus.cc:729] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f74896226344638ceff4e679aed330, State: Initialized, Role: FOLLOWER
I20260812 11:21:20.083828 22372 heartbeater.cc:503] Master 127.12.175.254:40695 was elected leader, sending a full tablet report...
I20260812 11:21:20.083861 22678 raft_consensus.cc:729] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34633693499b44c09ce2004af497fc7c, State: Initialized, Role: FOLLOWER
I20260812 11:21:20.084208 22680 consensus_queue.cc:260] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.084275 22678 consensus_queue.cc:260] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.084800 22113 heartbeater.cc:503] Master 127.12.175.254:40695 was elected leader, sending a full tablet report...
I20260812 11:21:20.085168 22680 ts_tablet_manager.cc:1428] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 11:21:20.085304 22675 ts_tablet_manager.cc:1428] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:21:20.085652 22647 heartbeater.cc:503] Master 127.12.175.254:40695 was elected leader, sending a full tablet report...
I20260812 11:21:20.087555 22678 ts_tablet_manager.cc:1428] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
W20260812 11:21:20.117683 22373 tablet.cc:2369] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:20.158739 22689 raft_consensus.cc:482] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:20.158918 22689 raft_consensus.cc:504] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.159976 22689 leader_election.cc:288] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f74896226344638ceff4e679aed330 (127.12.175.193:39645), 71f86b00237340668d764d46e319a9f4 (127.12.175.194:42419)
I20260812 11:21:20.161720 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.160205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42419 (local address 127.12.175.195:48025)
0812 11:21:20.160337 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.160352 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.160431 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.160664 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.160667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.160684 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:20.161175 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:20.161177 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:20.161189 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:20.161217 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:20.161475 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:20.161477 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:20.161481 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:21:20.161568 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:21:20.161604 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 11:21:20.161872 22673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.160305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:48025 (local address 127.12.175.194:42419)
0812 11:21:20.160433 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.160437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.160455 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:21:20.160503 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.160506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.160542 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.160626 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.161343 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.161347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.161349 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.161363 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.161386 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.161396 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.161482 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.161717 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.161759 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:20.161933 22690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.160205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39645 (local address 127.12.175.195:54079)
0812 11:21:20.160710 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.160722 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.160813 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.161079 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.161082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.161097 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:20.161444 (+ 347us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:20.161446 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:20.161455 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:20.161479 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:20.161679 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:20.161682 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:20.161685 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 11:21:20.161759 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:21:20.161792 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":151,"thread_start_us":148,"threads_started":1}
I20260812 11:21:20.161934 22670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.160307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:54079 (local address 127.12.175.193:39645)
0812 11:21:20.160445 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.160449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.160804 (+ 355us) server_negotiation.cc:407] Connection header received
0812 11:21:20.160898 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.160902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.160937 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.161048 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.161575 (+ 527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.161577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.161579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.161589 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.161606 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.161613 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.161677 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.161780 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.161816 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:21:20.162544 22022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4886db48019d440baba1214fa016695f" candidate_uuid: "34633693499b44c09ce2004af497fc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f74896226344638ceff4e679aed330" is_pre_election: true
I20260812 11:21:20.162541 22284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4886db48019d440baba1214fa016695f" candidate_uuid: "34633693499b44c09ce2004af497fc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71f86b00237340668d764d46e319a9f4" is_pre_election: true
I20260812 11:21:20.162781 22284 raft_consensus.cc:2454] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34633693499b44c09ce2004af497fc7c in term 0.
I20260812 11:21:20.162793 22022 raft_consensus.cc:2454] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34633693499b44c09ce2004af497fc7c in term 0.
I20260812 11:21:20.163209 22428 leader_election.cc:302] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34633693499b44c09ce2004af497fc7c, b2f74896226344638ceff4e679aed330; no voters:
I20260812 11:21:20.163482 22689 raft_consensus.cc:2781] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:20.163558 22689 raft_consensus.cc:482] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:20.163587 22689 raft_consensus.cc:3037] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:20.164593 22689 raft_consensus.cc:504] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.164889 22689 leader_election.cc:288] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [CANDIDATE]: Term 1 election: Requested vote from peers b2f74896226344638ceff4e679aed330 (127.12.175.193:39645), 71f86b00237340668d764d46e319a9f4 (127.12.175.194:42419)
I20260812 11:21:20.165203 22022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4886db48019d440baba1214fa016695f" candidate_uuid: "34633693499b44c09ce2004af497fc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f74896226344638ceff4e679aed330"
I20260812 11:21:20.165220 22284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4886db48019d440baba1214fa016695f" candidate_uuid: "34633693499b44c09ce2004af497fc7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71f86b00237340668d764d46e319a9f4"
I20260812 11:21:20.165299 22022 raft_consensus.cc:3037] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:20.165316 22284 raft_consensus.cc:3037] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:20.166253 22022 raft_consensus.cc:2454] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34633693499b44c09ce2004af497fc7c in term 1.
I20260812 11:21:20.166318 22284 raft_consensus.cc:2454] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34633693499b44c09ce2004af497fc7c in term 1.
I20260812 11:21:20.166581 22415 leader_election.cc:302] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34633693499b44c09ce2004af497fc7c, 71f86b00237340668d764d46e319a9f4; no voters:
I20260812 11:21:20.166739 22689 raft_consensus.cc:2781] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:20.166942 22689 raft_consensus.cc:686] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 1 LEADER]: Becoming Leader. State: Replica: 34633693499b44c09ce2004af497fc7c, State: Running, Role: LEADER
I20260812 11:21:20.167235 22689 consensus_queue.cc:237] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } }
I20260812 11:21:20.170159 21703 catalog_manager.cc:5495] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 34633693499b44c09ce2004af497fc7c (127.12.175.195). New cstate: current_term: 1 leader_uuid: "34633693499b44c09ce2004af497fc7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34633693499b44c09ce2004af497fc7c" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 37759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:20.181289 22674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.180023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49590 (local address 127.12.175.195:37759)
0812 11:21:20.180119 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.180123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.180152 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:21:20.180279 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.180281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.180329 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.180401 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.181001 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.181003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.181005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.181015 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.181035 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.181042 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.181106 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.181156 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.181183 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:21:20.186339 22022 raft_consensus.cc:1261] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 1 FOLLOWER]: Refusing update from remote peer 34633693499b44c09ce2004af497fc7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:20.186339 22284 raft_consensus.cc:1261] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 1 FOLLOWER]: Refusing update from remote peer 34633693499b44c09ce2004af497fc7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:20.186983 22691 consensus_queue.cc:1035] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "71f86b00237340668d764d46e319a9f4" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:20.187132 22689 consensus_queue.cc:1035] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f74896226344638ceff4e679aed330" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:20.194597 22700 mvcc.cc:205] Tried to move back new op lower bound from 7317641954037092352 to 7317641953967476736. Current Snapshot: MvccSnapshot[applied={T|T < 7317641954037092352}]
I20260812 11:21:20.194684 22699 mvcc.cc:205] Tried to move back new op lower bound from 7317641954037092352 to 7317641953967476736. Current Snapshot: MvccSnapshot[applied={T|T < 7317641954037092352}]
I20260812 11:21:20.202032 21701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:20.202160 21701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:20.204306 21701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc4db4259cf14c5a8289844cc6c0784e: Sending DeleteTablet for 3 replicas of tablet 4886db48019d440baba1214fa016695f
I20260812 11:21:20.204999 22245 tablet_service.cc:1514] Processing DeleteTablet for tablet 4886db48019d440baba1214fa016695f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:20 UTC) from {username='slave'} at 127.0.0.1:34890
I20260812 11:21:20.205044 21982 tablet_service.cc:1514] Processing DeleteTablet for tablet 4886db48019d440baba1214fa016695f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:20 UTC) from {username='slave'} at 127.0.0.1:48018
I20260812 11:21:20.205459 22720 tablet_replica.cc:330] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: stopping tablet replica
I20260812 11:21:20.205452 22515 tablet_service.cc:1514] Processing DeleteTablet for tablet 4886db48019d440baba1214fa016695f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:20 UTC) from {username='slave'} at 127.0.0.1:49582
I20260812 11:21:20.205751 22720 raft_consensus.cc:2229] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:20.205894 22727 tablet_replica.cc:330] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: stopping tablet replica
I20260812 11:21:20.206032 22720 raft_consensus.cc:2258] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:20.206326 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21824
I20260812 11:21:20.206367 22724 tablet_replica.cc:330] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330: stopping tablet replica
I20260812 11:21:20.206629 22724 raft_consensus.cc:2229] T 4886db48019d440baba1214fa016695f P b2f74896226344638ceff4e679aed330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:20.207518 22720 ts_tablet_manager.cc:1905] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:20.210481 22720 ts_tablet_manager.cc:1918] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:20.210575 22720 log.cc:1196] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/4886db48019d440baba1214fa016695f
I20260812 11:21:20.210783 22727 raft_consensus.cc:2229] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:20.211126 22727 raft_consensus.cc:2258] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:20.211591 22720 ts_tablet_manager.cc:1939] T 4886db48019d440baba1214fa016695f P 71f86b00237340668d764d46e319a9f4: Deleting consensus metadata
I20260812 11:21:20.212796 21663 catalog_manager.cc:4841] TS 71f86b00237340668d764d46e319a9f4 (127.12.175.194:42419): tablet 4886db48019d440baba1214fa016695f (table test-table [id=5e11752bf24b4755a9ce2a8e30bb4f35]) successfully deleted
I20260812 11:21:20.215370 22727 ts_tablet_manager.cc:1905] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:20.217612 22727 ts_tablet_manager.cc:1918] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:20.217694 22727 log.cc:1196] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/4886db48019d440baba1214fa016695f
I20260812 11:21:20.217981 22727 ts_tablet_manager.cc:1939] T 4886db48019d440baba1214fa016695f P 34633693499b44c09ce2004af497fc7c: Deleting consensus metadata
I20260812 11:21:20.218861 21671 catalog_manager.cc:4841] TS 34633693499b44c09ce2004af497fc7c (127.12.175.195:37759): tablet 4886db48019d440baba1214fa016695f (table test-table [id=5e11752bf24b4755a9ce2a8e30bb4f35]) successfully deleted
W20260812 11:21:20.221660 21671 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:39645 (error 108)
I20260812 11:21:20.221824 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22117
I20260812 11:21:20.230173 22671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.229831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39645 (local address 127.0.0.1:48020)
0812 11:21:20.230012 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.230087 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:39645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260812 11:21:20.230381 21671 catalog_manager.cc:4584] TS b2f74896226344638ceff4e679aed330 (127.12.175.193:39645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4886db48019d440baba1214fa016695f: Network error: Client connection negotiation failed: client connection to 127.12.175.193:39645: connect: Connection refused (error 111)
I20260812 11:21:20.236224 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22377
I20260812 11:21:20.249527 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21630
2026-08-12T11:21:20Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (929 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 11:21:20.278364 12991 mini_oidc.cc:152] Starting JWKS server
I20260812 11:21:20.279942 12991 webserver.cc:460] Webserver started at https://127.0.0.1:41501/ using document root <none> and password file <none>
I20260812 11:21:20.280095 12991 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:21:20.280345 12991 webserver.cc:460] Webserver started at http://127.0.0.1:43933/ using document root <none> and password file <none>
2026-08-12T11:21:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:20Z Disabled control of system clock
I20260812 11:21:20.289274 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39845
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39845
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41501/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/testchainca.cert with env {}
W20260812 11:21:20.398906 22742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:20.399125 22742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:20.399160 22742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:20.403033 22742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:20.403082 22742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:20.403097 22742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:20.403111 22742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:20.403126 22742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:21:20.403139 22742 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:21:20.403157 22742 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41501/jwks.json
I20260812 11:21:20.408193 22742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39845
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41501/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:20.409034 22742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:20.409876 22742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:20.417632 22755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:20.417713 22742 server_base.cc:1034] running on GCE node
W20260812 11:21:20.417687 22751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:20.417639 22749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:20.418431 22742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:20.419601 22742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:20.420774 22742 hybrid_clock.cc:648] HybridClock initialized: now 1786533680420754 us; error 25 us; skew 500 ppm
I20260812 11:21:20.422497 22742 webserver.cc:460] Webserver started at http://127.12.175.254:40845/ using document root <none> and password file <none>
I20260812 11:21:20.423017 22742 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:20.423082 22742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:20.423292 22742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:20.425256 22742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65"
format_stamp: "Formatted at 2026-08-12 11:21:20 on dist-test-slave-gjrz"
server_key: "658145444970ff9c78e2a28b1aac1415"
server_key_iv: "4078e4107e1957b5467fc37168264d98"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.425776 22742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65"
format_stamp: "Formatted at 2026-08-12 11:21:20 on dist-test-slave-gjrz"
server_key: "658145444970ff9c78e2a28b1aac1415"
server_key_iv: "4078e4107e1957b5467fc37168264d98"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.429167 22742 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:20.431339 22766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:20.432454 22742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:20.432566 22742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65"
format_stamp: "Formatted at 2026-08-12 11:21:20 on dist-test-slave-gjrz"
server_key: "658145444970ff9c78e2a28b1aac1415"
server_key_iv: "4078e4107e1957b5467fc37168264d98"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.432654 22742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:20.451017 22742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:20.451618 22742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:20.451768 22742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:20.457975 22742 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39845
I20260812 11:21:20.457986 22879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39845 every 8 connection(s)
I20260812 11:21:20.458801 22742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:20.461776 22880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:20.464272 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22742
I20260812 11:21:20.464382 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:20.464630 12991 external_mini_cluster.cc:1428] Setting key 4fab6f6e635ad5b652c888a130863e3f
I20260812 11:21:20.467321 22880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65: Bootstrap starting.
I20260812 11:21:20.469338 22880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:20.470013 22880 log.cc:824] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:20.471715 22880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65: No bootstrap required, opened a new log
I20260812 11:21:20.473042 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.465883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50192 (local address 127.12.175.254:39845)
0812 11:21:20.466494 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.466507 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.466539 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:21:20.467142 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.467160 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.467592 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.467887 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.468305 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.469222 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.470106 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.470588 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.470733 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.471503 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.471508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.471521 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.471889 (+ 368us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.471942 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.471964 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.472051 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.472177 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.472412 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":118,"threads_started":1}
I20260812 11:21:20.475037 22880 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39845 } }
I20260812 11:21:20.475250 22880 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:20.475324 22880 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd28a78ef5e4502a5a1f8ce3deb4e65, State: Initialized, Role: FOLLOWER
I20260812 11:21:20.475545 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:21:20.475742 22880 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39845 } }
I20260812 11:21:20.475868 22880 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:20.475930 22880 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:20.476022 22880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:20.476840 22880 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39845 } }
I20260812 11:21:20.477174 22880 leader_election.cc:302] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbd28a78ef5e4502a5a1f8ce3deb4e65; no voters:
I20260812 11:21:20.477489 22880 leader_election.cc:288] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:20.477569 22889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:20.477782 22889 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [term 1 LEADER]: Becoming Leader. State: Replica: cbd28a78ef5e4502a5a1f8ce3deb4e65, State: Running, Role: LEADER
I20260812 11:21:20.478092 22889 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39845 } }
I20260812 11:21:20.478556 22880 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:20.479478 22891 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbd28a78ef5e4502a5a1f8ce3deb4e65. Latest consensus state: current_term: 1 leader_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39845 } } }
I20260812 11:21:20.479617 22891 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:20.479863 22890 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd28a78ef5e4502a5a1f8ce3deb4e65" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39845 } } }
I20260812 11:21:20.479959 22890 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65 [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:20.482906 22917 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:20.482971 22917 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:20.483076 22905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:20.483963 22905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:20.488818 22905 catalog_manager.cc:1347] Generated new cluster ID: adf49fbea1a04ed79b938940724eca00
I20260812 11:21:20.488876 22905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:20.504657 22905 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:20.505430 22905 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:20.510401 22905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbd28a78ef5e4502a5a1f8ce3deb4e65: Generated new TSK 0
I20260812 11:21:20.510962 22905 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:21:20.553705 22931 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 11:21:20.553797 22931 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:21:20.554157 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.530731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50194 (local address 127.12.175.254:39845)
0812 11:21:20.530838 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.530844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.531019 (+ 175us) server_negotiation.cc:407] Connection header received
0812 11:21:20.531223 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.531225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.531291 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.531373 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:21:20.531630 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.532136 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.533298 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.533535 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.533607 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.533931 (+ 324us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:21:20.553813 (+ 19882us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:21:20.554058 (+ 245us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50194: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 11:21:20.554221 22887 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50194: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 11:21:20.555455 22930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:20.530608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39845 (local address 127.0.0.1:50194)
0812 11:21:20.530941 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.530955 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.531085 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.531403 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.531406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.531414 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:21:20.531538 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:20.531545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.532223 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.532226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:20.533198 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:20.533208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.533633 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.533636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:20.533729 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.533780 (+ 51us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:21:20.554039 (+ 20259us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:21:20.554235 (+ 196us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.175.254:39845: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":113,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.175.254:39845: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 11:21:20.556056 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22742
2026-08-12T11:21:20Z chronyd exiting
I20260812 11:21:20.602495 12991 test_util.cc:175] -----------------------------------------------
I20260812 11:21:20.602558 12991 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533654564615-12991-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (325 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 11:21:20.603536 12991 mini_oidc.cc:152] Starting JWKS server
I20260812 11:21:20.604326 12991 webserver.cc:460] Webserver started at https://127.0.0.1:36547/ using document root <none> and password file <none>
I20260812 11:21:20.604413 12991 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:21:20.604655 12991 webserver.cc:460] Webserver started at http://127.0.0.1:33295/ using document root <none> and password file <none>
2026-08-12T11:21:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:20Z Disabled control of system clock
I20260812 11:21:20.613531 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:40049
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:37079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:40049
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36547/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/testchainca.cert with env {}
W20260812 11:21:20.718757 22945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:20.718969 22945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:20.719004 22945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:20.722766 22945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:20.722808 22945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:20.722822 22945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:20.722837 22945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:20.722851 22945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:21:20.722872 22945 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:21:20.722884 22945 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36547/jwks.json
I20260812 11:21:20.727887 22945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:40049
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:40049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36547/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:20.728736 22945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:20.729606 22945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:20.737334 22951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:20.737385 22945 server_base.cc:1034] running on GCE node
W20260812 11:21:20.737323 22957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:20.737355 22952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:20.738040 22945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:20.739015 22945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:20.740183 22945 hybrid_clock.cc:648] HybridClock initialized: now 1786533680740158 us; error 36 us; skew 500 ppm
I20260812 11:21:20.741945 22945 webserver.cc:460] Webserver started at http://127.12.175.254:42401/ using document root <none> and password file <none>
I20260812 11:21:20.742506 22945 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:20.742569 22945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:20.742755 22945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:20.744671 22945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57"
format_stamp: "Formatted at 2026-08-12 11:21:20 on dist-test-slave-gjrz"
server_key: "fa45df6e5c6a6c47d8c9608258639576"
server_key_iv: "ed3c09785a0b2d7d57dd1bffca902fe3"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.745195 22945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57"
format_stamp: "Formatted at 2026-08-12 11:21:20 on dist-test-slave-gjrz"
server_key: "fa45df6e5c6a6c47d8c9608258639576"
server_key_iv: "ed3c09785a0b2d7d57dd1bffca902fe3"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.748589 22945 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:20.750998 22965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:20.752184 22945 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:20.752305 22945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57"
format_stamp: "Formatted at 2026-08-12 11:21:20 on dist-test-slave-gjrz"
server_key: "fa45df6e5c6a6c47d8c9608258639576"
server_key_iv: "ed3c09785a0b2d7d57dd1bffca902fe3"
server_key_version: "encryptionkey@0"
I20260812 11:21:20.752395 22945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:20.767112 22945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:20.767696 22945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:20.767848 22945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:20.774394 22945 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:40049
I20260812 11:21:20.774405 23072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:40049 every 8 connection(s)
I20260812 11:21:20.775287 22945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:20.778191 23075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:20.778407 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22945
I20260812 11:21:20.778525 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:20.778792 12991 external_mini_cluster.cc:1428] Setting key d06ff5447640466df2e34aa87249bf5c
I20260812 11:21:20.784771 23075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57: Bootstrap starting.
I20260812 11:21:20.787286 23075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:20.788162 23075 log.cc:824] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:20.788786 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.779991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.12.175.254:40049)
0812 11:21:20.780583 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.780599 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.780634 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:21:20.781306 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.781324 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.781690 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.781969 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.782359 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.783657 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.784868 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.785541 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.785694 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.786752 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.786757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.786771 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:20.787121 (+ 350us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.787175 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:20.787195 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.787296 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.787682 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.787939 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":116,"threads_started":1}
I20260812 11:21:20.789961 23075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57: No bootstrap required, opened a new log
I20260812 11:21:20.791360 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:21:20.793596 23075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40049 } }
I20260812 11:21:20.793792 23075 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:20.793838 23075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdf9e2f91c34aa190d0f4e393dd9a57, State: Initialized, Role: FOLLOWER
I20260812 11:21:20.794166 23075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40049 } }
I20260812 11:21:20.794273 23075 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:20.794337 23075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:20.794433 23075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:20.795295 23075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40049 } }
I20260812 11:21:20.795608 23075 leader_election.cc:302] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fdf9e2f91c34aa190d0f4e393dd9a57; no voters:
I20260812 11:21:20.795879 23075 leader_election.cc:288] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:20.795966 23086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:20.796159 23086 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [term 1 LEADER]: Becoming Leader. State: Replica: 1fdf9e2f91c34aa190d0f4e393dd9a57, State: Running, Role: LEADER
I20260812 11:21:20.796432 23086 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40049 } }
I20260812 11:21:20.796948 23075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:20.797937 23089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fdf9e2f91c34aa190d0f4e393dd9a57. Latest consensus state: current_term: 1 leader_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40049 } } }
I20260812 11:21:20.798084 23089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:20.798319 23088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fdf9e2f91c34aa190d0f4e393dd9a57" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 40049 } } }
I20260812 11:21:20.798405 23088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:20.798668 23100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:20.801172 23100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:20.805876 23100 catalog_manager.cc:1347] Generated new cluster ID: 26a3556694d841bd9b37e3a7db378cab
I20260812 11:21:20.805936 23100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:20.863428 23100 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:20.864573 23100 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:20.869165 23100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fdf9e2f91c34aa190d0f4e393dd9a57: Generated new TSK 0
I20260812 11:21:20.869863 23100 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:21:20.897136 23125 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 11:21:20.897199 23125 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260812 11:21:20.897907 23123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:20.882453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:40049 (local address 127.0.0.1:37210)
0812 11:21:20.882762 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.882774 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:20.882864 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:20.883154 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:20.883157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:20.883165 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:21:20.883307 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:20.883315 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.884288 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.884290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:20.884910 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:20.884917 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.885430 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.885433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:20.885506 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.885528 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:21:20.897627 (+ 12099us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36547/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:21:20.897759 (+ 132us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.175.254:40049: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36547/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":105,"threads_started":1}
I20260812 11:21:20.897905 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.882543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37210 (local address 127.12.175.254:40049)
0812 11:21:20.882694 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.882699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.882842 (+ 143us) server_negotiation.cc:407] Connection header received
0812 11:21:20.882972 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.882975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.883033 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.883138 (+ 105us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:21:20.883426 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.884194 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.885013 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.885327 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.885431 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.885681 (+ 250us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:21:20.897465 (+ 11784us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36547/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:21:20.897750 (+ 285us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37210: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36547/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":84}
W20260812 11:21:20.897961 23084 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37210: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36547/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260812 11:21:20.898818 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22945
2026-08-12T11:21:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (346 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 11:21:20.949997 12991 mini_oidc.cc:152] Starting JWKS server
I20260812 11:21:20.950804 12991 webserver.cc:460] Webserver started at https://127.0.0.1:46257/ using document root <none> and password file <none>
I20260812 11:21:20.950892 12991 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:21:20.951112 12991 webserver.cc:460] Webserver started at http://127.0.0.1:42155/ using document root <none> and password file <none>
2026-08-12T11:21:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:20Z Disabled control of system clock
I20260812 11:21:20.959913 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39745
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39745
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46257/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:21:21.066473 23138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:21.066690 23138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:21.066728 23138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:21.070588 23138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:21.070636 23138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:21.070650 23138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:21.070679 23138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:21.070706 23138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:21:21.070734 23138 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:21:21.070761 23138 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46257/jwks.json
I20260812 11:21:21.075256 23138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39745
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46257/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:21.076179 23138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:21.077410 23138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:21.085325 23151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:21.085345 23144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:21.085451 23138 server_base.cc:1034] running on GCE node
W20260812 11:21:21.085335 23157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:21.086107 23138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:21.087069 23138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:21.088218 23138 hybrid_clock.cc:648] HybridClock initialized: now 1786533681088198 us; error 30 us; skew 500 ppm
I20260812 11:21:21.089865 23138 webserver.cc:460] Webserver started at http://127.12.175.254:42215/ using document root <none> and password file <none>
I20260812 11:21:21.090394 23138 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:21.090453 23138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:21.090646 23138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:21.092586 23138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "36238060ef8445ffbcf8c5291fbf7898"
format_stamp: "Formatted at 2026-08-12 11:21:21 on dist-test-slave-gjrz"
server_key: "134473a65f6ef51d6783abd51bdeb077"
server_key_iv: "1d374560c98812a67f9d83e35b44dad7"
server_key_version: "encryptionkey@0"
I20260812 11:21:21.093102 23138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "36238060ef8445ffbcf8c5291fbf7898"
format_stamp: "Formatted at 2026-08-12 11:21:21 on dist-test-slave-gjrz"
server_key: "134473a65f6ef51d6783abd51bdeb077"
server_key_iv: "1d374560c98812a67f9d83e35b44dad7"
server_key_version: "encryptionkey@0"
I20260812 11:21:21.096493 23138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:21.098670 23169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:21.099804 23138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:21.099906 23138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "36238060ef8445ffbcf8c5291fbf7898"
format_stamp: "Formatted at 2026-08-12 11:21:21 on dist-test-slave-gjrz"
server_key: "134473a65f6ef51d6783abd51bdeb077"
server_key_iv: "1d374560c98812a67f9d83e35b44dad7"
server_key_version: "encryptionkey@0"
I20260812 11:21:21.099998 23138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:21.121201 23138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:21.121766 23138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:21.121937 23138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:21.128137 23138 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39745
I20260812 11:21:21.128211 23267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39745 every 8 connection(s)
I20260812 11:21:21.128983 23138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:21.131877 23268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:21.135202 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23138
I20260812 11:21:21.135346 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:21.135654 12991 external_mini_cluster.cc:1428] Setting key 396e598c7544df374da981ff31f49a5d
I20260812 11:21:21.137588 23268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898: Bootstrap starting.
I20260812 11:21:21.139700 23268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:21.140377 23268 log.cc:824] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:21.142022 23268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898: No bootstrap required, opened a new log
I20260812 11:21:21.144364 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:21.136912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38974 (local address 127.12.175.254:39745)
0812 11:21:21.137496 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:21.137510 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:21.137553 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:21:21.138161 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:21.138178 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:21.138545 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:21.138833 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:21.139240 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.140287 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.141159 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.141617 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.141760 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:21.142570 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:21.142575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:21.142587 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:21.142929 (+ 342us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:21.142981 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:21.143000 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:21.143085 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:21.143221 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:21:21.143505 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":127,"threads_started":1}
I20260812 11:21:21.144860 23268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36238060ef8445ffbcf8c5291fbf7898" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39745 } }
I20260812 11:21:21.145062 23268 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:21.145108 23268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36238060ef8445ffbcf8c5291fbf7898, State: Initialized, Role: FOLLOWER
I20260812 11:21:21.145504 23268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36238060ef8445ffbcf8c5291fbf7898" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39745 } }
I20260812 11:21:21.145637 23268 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:21.145700 23268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:21.145798 23268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:21.146625 23268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36238060ef8445ffbcf8c5291fbf7898" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39745 } }
I20260812 11:21:21.146843 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:21:21.146955 23268 leader_election.cc:302] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36238060ef8445ffbcf8c5291fbf7898; no voters:
I20260812 11:21:21.147243 23268 leader_election.cc:288] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:21.147359 23280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:21.147560 23280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [term 1 LEADER]: Becoming Leader. State: Replica: 36238060ef8445ffbcf8c5291fbf7898, State: Running, Role: LEADER
I20260812 11:21:21.147848 23280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36238060ef8445ffbcf8c5291fbf7898" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39745 } }
I20260812 11:21:21.148423 23268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:21.149000 23283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36238060ef8445ffbcf8c5291fbf7898. Latest consensus state: current_term: 1 leader_uuid: "36238060ef8445ffbcf8c5291fbf7898" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36238060ef8445ffbcf8c5291fbf7898" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39745 } } }
I20260812 11:21:21.149137 23283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:21.149430 23282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36238060ef8445ffbcf8c5291fbf7898" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36238060ef8445ffbcf8c5291fbf7898" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39745 } } }
I20260812 11:21:21.149515 23290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:21.149539 23282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:21.152546 23290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:21.157569 23290 catalog_manager.cc:1347] Generated new cluster ID: 647946444e854a2793301c1036b11daf
I20260812 11:21:21.157619 23290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:21.171059 23290 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:21.171891 23290 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:21.179103 23290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36238060ef8445ffbcf8c5291fbf7898: Generated new TSK 0
I20260812 11:21:21.179706 23290 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:21.191039 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:21.186609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38986 (local address 127.12.175.254:39745)
0812 11:21:21.186712 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:21.186717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:21.186911 (+ 194us) server_negotiation.cc:407] Connection header received
0812 11:21:21.187077 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:21.187079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:21.187127 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:21.187216 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:21:21.187471 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.187993 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.188862 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.189088 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.189173 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:21.189466 (+ 293us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:21:21.190691 (+ 1225us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46257/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:21:21.190904 (+ 213us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38986: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46257/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 11:21:21.191092 23273 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38986: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46257/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 11:21:21.192948 23320 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:21.186554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39745 (local address 127.0.0.1:38986)
0812 11:21:21.186830 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:21.186842 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:21.186948 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:21.187231 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:21.187234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:21.187242 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:21:21.187372 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:21.187377 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.188113 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.188116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:21.188752 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:21.188760 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.189207 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.189211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:21.189297 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:21.189318 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:21:21.190852 (+ 1534us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46257/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:21:21.192780 (+ 1928us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.175.254:39745: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46257/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":1733,"thread_start_us":105,"threads_started":1}
I20260812 11:21:21.193260 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23138
E20260812 11:21:21.221320 23322 webserver.cc:533] Webserver: sslize failed:
E20260812 11:21:21.221444 23322 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T11:21:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (310 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T11:21:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:21Z Disabled control of system clock
I20260812 11:21:21.269690 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38025
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:41991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38025
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/testchainca.cert with env {}
W20260812 11:21:21.375367 23332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:21.375576 23332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:21.375612 23332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:21.379410 23332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:21.379453 23332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:21.379467 23332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:21.379482 23332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:21.379495 23332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:21:21.379508 23332 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:21:21.379526 23332 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 11:21:21.384519 23332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38025
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:21.385327 23332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:21.386157 23332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:21.393865 23342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:21.393987 23332 server_base.cc:1034] running on GCE node
W20260812 11:21:21.393882 23343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:21.393867 23347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:21.394614 23332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:21.395593 23332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:21.396747 23332 hybrid_clock.cc:648] HybridClock initialized: now 1786533681396735 us; error 23 us; skew 500 ppm
I20260812 11:21:21.398355 23332 webserver.cc:460] Webserver started at http://127.12.175.254:44957/ using document root <none> and password file <none>
I20260812 11:21:21.398851 23332 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:21.398908 23332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:21.399085 23332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:21.400925 23332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "824e259b301645a4a5ed2352284c45b4"
format_stamp: "Formatted at 2026-08-12 11:21:21 on dist-test-slave-gjrz"
server_key: "b7048a8dc521a832d7d2be77243d56db"
server_key_iv: "67e98fd023b5f9b94e2719531aa14cea"
server_key_version: "encryptionkey@0"
I20260812 11:21:21.401432 23332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "824e259b301645a4a5ed2352284c45b4"
format_stamp: "Formatted at 2026-08-12 11:21:21 on dist-test-slave-gjrz"
server_key: "b7048a8dc521a832d7d2be77243d56db"
server_key_iv: "67e98fd023b5f9b94e2719531aa14cea"
server_key_version: "encryptionkey@0"
I20260812 11:21:21.404764 23332 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 11:21:21.406876 23359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:21.407967 23332 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:21.408074 23332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "824e259b301645a4a5ed2352284c45b4"
format_stamp: "Formatted at 2026-08-12 11:21:21 on dist-test-slave-gjrz"
server_key: "b7048a8dc521a832d7d2be77243d56db"
server_key_iv: "67e98fd023b5f9b94e2719531aa14cea"
server_key_version: "encryptionkey@0"
I20260812 11:21:21.408159 23332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:21.417733 23332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:21.418260 23332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:21.418407 23332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:21.424582 23332 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:38025
I20260812 11:21:21.424595 23451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:38025 every 8 connection(s)
I20260812 11:21:21.425364 23332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:21.428160 23454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:21.433286 23454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4: Bootstrap starting.
I20260812 11:21:21.434659 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23332
I20260812 11:21:21.434792 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:21.435082 12991 external_mini_cluster.cc:1428] Setting key 9d2ea0a7ef0b8218fdf8945d0e177cf1
I20260812 11:21:21.435846 23454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:21.436630 23454 log.cc:824] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:21.438612 23454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4: No bootstrap required, opened a new log
I20260812 11:21:21.442462 23454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "824e259b301645a4a5ed2352284c45b4" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38025 } }
I20260812 11:21:21.442715 23454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:21.442775 23454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 824e259b301645a4a5ed2352284c45b4, State: Initialized, Role: FOLLOWER
I20260812 11:21:21.443185 23454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "824e259b301645a4a5ed2352284c45b4" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38025 } }
I20260812 11:21:21.443338 23454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:21.443403 23454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:21.443495 23454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:21.443512 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:21.436111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52912 (local address 127.12.175.254:38025)
0812 11:21:21.436666 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:21.436680 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:21.436712 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:21:21.437443 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:21.437468 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:21.437784 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:21.438041 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:21.438347 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.439340 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.440515 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.440959 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.441070 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:21.441837 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:21.441843 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:21.441854 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:21.442212 (+ 358us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:21.442265 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:21.442284 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:21.442353 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:21.442496 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:21:21.442735 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":102,"threads_started":1}
I20260812 11:21:21.444254 23454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "824e259b301645a4a5ed2352284c45b4" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38025 } }
I20260812 11:21:21.444577 23454 leader_election.cc:302] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 824e259b301645a4a5ed2352284c45b4; no voters:
I20260812 11:21:21.444877 23454 leader_election.cc:288] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:21.444963 23466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:21.445174 23466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [term 1 LEADER]: Becoming Leader. State: Replica: 824e259b301645a4a5ed2352284c45b4, State: Running, Role: LEADER
I20260812 11:21:21.445465 23466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "824e259b301645a4a5ed2352284c45b4" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38025 } }
I20260812 11:21:21.446010 23454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:21.446307 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:21:21.446530 23466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 824e259b301645a4a5ed2352284c45b4. Latest consensus state: current_term: 1 leader_uuid: "824e259b301645a4a5ed2352284c45b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "824e259b301645a4a5ed2352284c45b4" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38025 } } }
I20260812 11:21:21.446645 23466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:21.447027 23467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "824e259b301645a4a5ed2352284c45b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "824e259b301645a4a5ed2352284c45b4" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38025 } } }
I20260812 11:21:21.447130 23467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4 [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:21.450600 23490 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:21.450677 23490 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:21.450742 23474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:21.451521 23474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:21.456000 23474 catalog_manager.cc:1347] Generated new cluster ID: b77e009975dc4de4905d0e9c3f9433c6
I20260812 11:21:21.456061 23474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:21.484881 23474 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:21.485702 23474 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:21.502310 23474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 824e259b301645a4a5ed2352284c45b4: Generated new TSK 0
I20260812 11:21:21.502903 23474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:21.526643 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:21.515875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.12.175.254:38025)
0812 11:21:21.515992 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:21.515997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:21.516160 (+ 163us) server_negotiation.cc:407] Connection header received
0812 11:21:21.516315 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:21.516317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:21.516361 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:21.516440 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:21:21.516681 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.517199 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.518444 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.518648 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.518713 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:21.519010 (+ 297us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:21:21.526370 (+ 7360us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:21:21.526552 (+ 182us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52928: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 11:21:21.526695 23464 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52928: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 11:21:21.527074 23510 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:21.515798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38025 (local address 127.0.0.1:52928)
0812 11:21:21.516080 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:21.516094 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:21.516207 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:21.516461 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:21.516464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:21.516473 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:21:21.516594 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:21.516600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.517320 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.517324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:21.518346 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:21.518358 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:21.518755 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:21.518759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:21.518853 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:21.518882 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:21:21.526533 (+ 7651us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:21:21.526684 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.175.254:38025: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":91,"threads_started":1}
I20260812 11:21:21.527843 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23332
2026-08-12T11:21:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (295 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (117 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (117 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:21 dist-test-slave-gjrz krb5kdc[23531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:21 dist-test-slave-gjrz krb5kdc[23531](info): set up 2 sockets
Aug 12 11:21:21 dist-test-slave-gjrz krb5kdc[23531](info): commencing operation
krb5kdc: starting...
W20260812 11:21:22.954617 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:23.063673 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33741
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:33741
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:23.169812 23554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:23.170030 23554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:23.170066 23554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:23.173907 23554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:23.173959 23554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:23.173978 23554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:23.173992 23554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:23.174005 23554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:23.178885 23554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:33741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:23.179734 23554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:23.180579 23554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:23.188473 23564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:23.188499 23566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:23.188563 23554 server_base.cc:1034] running on GCE node
W20260812 11:21:23.188472 23568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:23.189241 23554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:23.190225 23554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:23.191346 23554 hybrid_clock.cc:648] HybridClock initialized: now 1786533683191323 us; error 30 us; skew 500 ppm
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.193856 23554 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:23.194679 23554 webserver.cc:460] Webserver started at http://127.12.175.254:38273/ using document root <none> and password file <none>
I20260812 11:21:23.195180 23554 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:23.195243 23554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:23.195456 23554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:23.197333 23554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "634b9f6d0eda4dee8d80ec042ef3b220"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "a3056f459584b0cc11f03eec9e3058ab"
server_key_iv: "8b8668215b1a9820f4be632e0df06c9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.197852 23554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "634b9f6d0eda4dee8d80ec042ef3b220"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "a3056f459584b0cc11f03eec9e3058ab"
server_key_iv: "8b8668215b1a9820f4be632e0df06c9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.201360 23554 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:21:23.203621 23580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.204715 23554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:23.204823 23554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "634b9f6d0eda4dee8d80ec042ef3b220"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "a3056f459584b0cc11f03eec9e3058ab"
server_key_iv: "8b8668215b1a9820f4be632e0df06c9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.204909 23554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:23.225206 23554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:23.227708 23554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:23.227866 23554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:23.234345 23554 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:33741
I20260812 11:21:23.234375 23692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:33741 every 8 connection(s)
I20260812 11:21:23.235183 23554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:23.237782 23693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:23.238656 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23554
I20260812 11:21:23.238783 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:23.239120 12991 external_mini_cluster.cc:1428] Setting key 892f456fbfae9ae63bda14c6b41a7281
I20260812 11:21:23.243709 23693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220: Bootstrap starting.
I20260812 11:21:23.245814 23693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:23.246510 23693 log.cc:824] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:23.248404 23693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220: No bootstrap required, opened a new log
I20260812 11:21:23.251827 23696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.240493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.12.175.254:33741)
0812 11:21:23.240910 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.240925 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.240959 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:21:23.241576 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.241592 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.241901 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.242189 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.242962 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.243985 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.244813 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.245260 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.245402 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.247727 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.247732 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.247746 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.247771 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.249287 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.249684 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.249689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.249693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.249795 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.250045 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.250048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.250050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.250396 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.250584 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.250840 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.251094 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":131,"threads_started":1}
I20260812 11:21:23.251778 23693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33741 } }
I20260812 11:21:23.252043 23693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:23.252100 23693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 634b9f6d0eda4dee8d80ec042ef3b220, State: Initialized, Role: FOLLOWER
I20260812 11:21:23.252506 23693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33741 } }
I20260812 11:21:23.252626 23693 raft_consensus.cc:388] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:23.252684 23693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:23.252779 23693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:23.253798 23693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33741 } }
I20260812 11:21:23.254148 23693 leader_election.cc:302] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 634b9f6d0eda4dee8d80ec042ef3b220; no voters:
I20260812 11:21:23.254418 23693 leader_election.cc:288] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:23.254506 23702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:23.254745 23702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [term 1 LEADER]: Becoming Leader. State: Replica: 634b9f6d0eda4dee8d80ec042ef3b220, State: Running, Role: LEADER
I20260812 11:21:23.255025 23702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33741 } }
I20260812 11:21:23.255523 23693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:23.256609 23704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 634b9f6d0eda4dee8d80ec042ef3b220. Latest consensus state: current_term: 1 leader_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33741 } } }
I20260812 11:21:23.256742 23704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:23.256605 23703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634b9f6d0eda4dee8d80ec042ef3b220" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33741 } } }
I20260812 11:21:23.256867 23703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:23.257169 23713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:23.259764 23713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:23.264856 23713 catalog_manager.cc:1347] Generated new cluster ID: 7fc8e5e6a0b74318a2fe815a4576c7ea
I20260812 11:21:23.264915 23713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:23.281136 23713 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:23.282299 23713 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:23.287083 23713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 634b9f6d0eda4dee8d80ec042ef3b220: Generated new TSK 0
I20260812 11:21:23.287815 23713 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:23.319510 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33741
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:23.425326 23740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:23.425560 23740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:23.425599 23740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:23.429458 23740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:23.429504 23740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:23.429569 23740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:23.434573 23740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:23.435489 23740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:23.436388 23740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:23.445029 23749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:23.445080 23747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:23.445104 23746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:23.445364 23740 server_base.cc:1034] running on GCE node
I20260812 11:21:23.445755 23740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:23.446332 23740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:23.447532 23740 hybrid_clock.cc:648] HybridClock initialized: now 1786533683447505 us; error 36 us; skew 500 ppm
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.452873 23740 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:23.453675 23740 webserver.cc:460] Webserver started at http://127.12.175.193:34371/ using document root <none> and password file <none>
I20260812 11:21:23.454190 23740 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:23.454254 23740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:23.454437 23740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:23.456466 23740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "01c491d6a8924d79b7ca7ab9c101f7fd"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "f257ab832a8fa166879285796d1a6bd5"
server_key_iv: "e151d7258ca5f47505863544b1750c78"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.457041 23740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "01c491d6a8924d79b7ca7ab9c101f7fd"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "f257ab832a8fa166879285796d1a6bd5"
server_key_iv: "e151d7258ca5f47505863544b1750c78"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.460582 23740 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:23.462843 23768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.463991 23740 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:23.464108 23740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "01c491d6a8924d79b7ca7ab9c101f7fd"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "f257ab832a8fa166879285796d1a6bd5"
server_key_iv: "e151d7258ca5f47505863544b1750c78"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.464197 23740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:23.479566 23740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:23.482007 23740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:23.482161 23740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:23.482666 23740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:23.483440 23740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:23.483489 23740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.483541 23740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:23.483569 23740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.492228 23740 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:38083
I20260812 11:21:23.492285 24007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:38083 every 8 connection(s)
I20260812 11:21:23.493237 23740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:23.495301 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23740
I20260812 11:21:23.495428 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:23.495699 12991 external_mini_cluster.cc:1428] Setting key d87d81a900a58b4cadb8af53473041ff
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:23.508936 23696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.495102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:43363 (local address 127.12.175.254:33741)
0812 11:21:23.495241 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.495246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.497016 (+ 1770us) server_negotiation.cc:407] Connection header received
0812 11:21:23.498691 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.498695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.498776 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.498997 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.501020 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.501776 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.502859 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.503216 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.503373 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.505716 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.505720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.505723 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.505754 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.507114 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.507600 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.507603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.507605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.507684 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.507955 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.507957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.507958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.508118 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.508188 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.508669 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.508818 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
I20260812 11:21:23.509632 24015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.496317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33741 (local address 127.12.175.193:43363)
0812 11:21:23.496859 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:23.496912 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:23.498405 (+ 1493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:23.499174 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:23.499184 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:23.499691 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:23.500862 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:23.500879 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.501891 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.501893 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:23.502743 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:23.502751 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.503389 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.503392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:23.503529 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.504026 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:23.504048 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:23.505550 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:23.507215 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:23.507219 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:23.507229 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:23.507505 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:23.507755 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:23.507757 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:23.507759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:23.507881 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:23.508195 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:23.508199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:23.508414 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 11:21:23.508572 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 11:21:23.508825 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":158,"threads_started":1}
I20260812 11:21:23.510951 24008 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33741
I20260812 11:21:23.511164 24008 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:23.511627 24008 heartbeater.cc:511] Master 127.12.175.254:33741 requested a full tablet report, sending...
I20260812 11:21:23.512946 23608 ts_manager.cc:194] Registered new tserver with Master: 01c491d6a8924d79b7ca7ab9c101f7fd (127.12.175.193:38083)
I20260812 11:21:23.513994 23608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:43363
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:23.523773 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33741
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:23.628719 24021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:23.628930 24021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:23.628983 24021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:23.632858 24021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:23.632903 24021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:23.632977 24021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:23.637885 24021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:23.638756 24021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:23.639647 24021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:23.648460 24031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:23.648488 24030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:23.648672 24021 server_base.cc:1034] running on GCE node
W20260812 11:21:23.648672 24035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:23.649119 24021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:23.649652 24021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:23.650789 24021 hybrid_clock.cc:648] HybridClock initialized: now 1786533683650772 us; error 33 us; skew 500 ppm
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.653297 24021 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:23.654037 24021 webserver.cc:460] Webserver started at http://127.12.175.194:37273/ using document root <none> and password file <none>
I20260812 11:21:23.654501 24021 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:23.654556 24021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:23.654712 24021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:23.656698 24021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "04796986226f4ae5875c828e81c10f11"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "65de71fd1728c463eb706cb3dfbe45ec"
server_key_iv: "0a3b360d293ca25425ea7f8f76d1db7b"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.657199 24021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "04796986226f4ae5875c828e81c10f11"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "65de71fd1728c463eb706cb3dfbe45ec"
server_key_iv: "0a3b360d293ca25425ea7f8f76d1db7b"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.660595 24021 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:23.662776 24043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.663866 24021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:23.663972 24021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "04796986226f4ae5875c828e81c10f11"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "65de71fd1728c463eb706cb3dfbe45ec"
server_key_iv: "0a3b360d293ca25425ea7f8f76d1db7b"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.664062 24021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:23.674849 24021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:23.677225 24021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:23.677376 24021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:23.677875 24021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:23.678607 24021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:23.678653 24021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.678695 24021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:23.678726 24021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.686606 24021 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:37065
I20260812 11:21:23.686656 24274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:37065 every 8 connection(s)
I20260812 11:21:23.687418 24021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:23.689039 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24021
I20260812 11:21:23.689160 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:23.689440 12991 external_mini_cluster.cc:1428] Setting key 4ff45bd73d02ee49c15a4699f5946fc6
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:21:23.701632 23696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.689029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39459 (local address 127.12.175.254:33741)
0812 11:21:23.689186 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.689191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.690030 (+ 839us) server_negotiation.cc:407] Connection header received
0812 11:21:23.691430 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.691434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.691485 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.691568 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.693402 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.693920 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.695459 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.695680 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.695790 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.698435 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.698438 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.698440 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.698465 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.699751 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.700319 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.700321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.700323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.700398 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.700647 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.700649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.700650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.700819 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.700905 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.701363 (+ 458us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.701478 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
I20260812 11:21:23.702487 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.689434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33741 (local address 127.12.175.194:39459)
0812 11:21:23.689892 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:23.689940 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:23.691149 (+ 1209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:23.691884 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:23.691922 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:23.692607 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:23.693234 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:23.693252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.694055 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.694058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:23.695339 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:23.695350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.695845 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.695849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:23.696055 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.696584 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:23.696605 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:23.698274 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:23.699867 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:23.699874 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:23.699888 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:23.700223 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:23.700463 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:23.700465 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:23.700466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:23.700584 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:23.700923 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:23.700930 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:23.701143 (+ 213us) client_negotiation.cc:769] Sending connection context
0812 11:21:23.701304 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 11:21:23.701601 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":108,"threads_started":1}
I20260812 11:21:23.703634 24279 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33741
I20260812 11:21:23.703905 24279 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:23.704463 24279 heartbeater.cc:511] Master 127.12.175.254:33741 requested a full tablet report, sending...
I20260812 11:21:23.705576 23608 ts_manager.cc:194] Registered new tserver with Master: 04796986226f4ae5875c828e81c10f11 (127.12.175.194:37065)
I20260812 11:21:23.706326 23608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:39459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:23.716115 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33741
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:34685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:23.822748 24289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:23.822960 24289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:23.822997 24289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:23.826869 24289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:23.826916 24289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:23.826972 24289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:23.831833 24289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:23.832664 24289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:23.833530 24289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:23.842371 24300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:23.842389 24301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:23.842512 24308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:23.842767 24289 server_base.cc:1034] running on GCE node
I20260812 11:21:23.843119 24289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:23.843695 24289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:23.844851 24289 hybrid_clock.cc:648] HybridClock initialized: now 1786533683844824 us; error 34 us; skew 500 ppm
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.847419 24289 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:23.848177 24289 webserver.cc:460] Webserver started at http://127.12.175.195:39049/ using document root <none> and password file <none>
I20260812 11:21:23.848634 24289 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:23.848687 24289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:23.848834 24289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:23.850646 24289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "d5b4aecd1a4b467fb4921c4b5b7ec4ce"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "4242e17f75c1afaf1cf41bd117ec16c3"
server_key_iv: "66d546598f229afae5b45f983d213472"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.851130 24289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "d5b4aecd1a4b467fb4921c4b5b7ec4ce"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "4242e17f75c1afaf1cf41bd117ec16c3"
server_key_iv: "66d546598f229afae5b45f983d213472"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.854458 24289 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:23.856712 24318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.857823 24289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:23.857918 24289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "d5b4aecd1a4b467fb4921c4b5b7ec4ce"
format_stamp: "Formatted at 2026-08-12 11:21:23 on dist-test-slave-gjrz"
server_key: "4242e17f75c1afaf1cf41bd117ec16c3"
server_key_iv: "66d546598f229afae5b45f983d213472"
server_key_version: "encryptionkey@0"
I20260812 11:21:23.858008 24289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:23.868247 24289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:23.870968 24289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:23.871130 24289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:23.871675 24289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:23.872388 24289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:23.872433 24289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.872471 24289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:23.872500 24289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:23.880602 24554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:33679 every 8 connection(s)
I20260812 11:21:23.880658 24289 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:33679
I20260812 11:21:23.881409 24289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:23.891244 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24289
I20260812 11:21:23.891373 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:23.891660 12991 external_mini_cluster.cc:1428] Setting key 6868cb555feb858536de31fb3dc63ce9
I20260812 11:21:23.893563 23696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.883014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:46285 (local address 127.12.175.254:33741)
0812 11:21:23.883129 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.883133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.883881 (+ 748us) server_negotiation.cc:407] Connection header received
0812 11:21:23.885072 (+ 1191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.885075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.885122 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.885191 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.886189 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.886687 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.887774 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.888018 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.888106 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.890203 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.890206 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.890208 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.890231 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.891529 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.892058 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.892061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.892063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.892159 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.892513 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.892516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.892518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.892692 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.892779 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.893294 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.893405 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:21:23.894191 24557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.883327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33741 (local address 127.12.175.195:46285)
0812 11:21:23.883744 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:23.883783 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:23.884887 (+ 1104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:23.885329 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:23.885335 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:23.885652 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:23.886077 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:23.886090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.886769 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.886771 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:23.887665 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:23.887674 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.888135 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.888137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:23.888261 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.888680 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:23.888698 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:23.890064 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:23.891645 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:23.891650 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:23.891662 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:23.891965 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:23.892249 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:23.892252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:23.892254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:23.892424 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:23.892798 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:23.892803 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:23.893060 (+ 257us) client_negotiation.cc:769] Sending connection context
0812 11:21:23.893208 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 11:21:23.893418 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260812 11:21:23.895083 24555 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33741
I20260812 11:21:23.895298 24555 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:23.895720 24555 heartbeater.cc:511] Master 127.12.175.254:33741 requested a full tablet report, sending...
I20260812 11:21:23.896592 23608 ts_manager.cc:194] Registered new tserver with Master: d5b4aecd1a4b467fb4921c4b5b7ec4ce (127.12.175.195:33679)
I20260812 11:21:23.897106 23608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:46285
I20260812 11:21:23.905112 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/test-admin.keytab.
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.920480 12991 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 11:21:23.922793 24568 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:23.921592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42306 (local address 127.12.175.193:38083)
0812 11:21:23.921942 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.921951 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.921971 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:21:23.922014 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.922018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.922164 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.922269 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.922628 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42306: BlockingRecv error: recv got EOF from 127.0.0.1:42306 (error 108)
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":149,"threads_started":1}
W20260812 11:21:23.922922 12991 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.923861 12991 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.924682 12991 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:21:23.932683 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.925408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.12.175.193:38083)
0812 11:21:23.925535 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.925543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.925559 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:21:23.925654 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.925656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.925691 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.925750 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.926167 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.926891 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.927662 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.927991 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.928074 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.929928 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.929937 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.929947 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.929970 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.931371 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.931695 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.931699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.931700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.931769 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.931941 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.931942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.931943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.932148 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.932278 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.932417 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.932554 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 11:21:23.935848 24568 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:23.935004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42314 (local address 127.12.175.193:38083)
0812 11:21:23.935111 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.935115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.935175 (+ 60us) server_negotiation.cc:407] Connection header received
0812 11:21:23.935311 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.935314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.935350 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.935406 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.935765 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42314: BlockingRecv error: recv got EOF from 127.0.0.1:42314 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 11:21:23.935953 12991 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.936791 12991 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.937510 12991 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:21:23.944470 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.938202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42316 (local address 127.12.175.193:38083)
0812 11:21:23.938311 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.938315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.938368 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:21:23.938445 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.938447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.938478 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.938542 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.938910 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.939426 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.940088 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.940289 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.940350 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.942140 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.942142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.942144 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.942164 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.943173 (+ 1009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.943550 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.943553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.943554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.943619 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.943807 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.943809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.943810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.943941 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.944032 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.944263 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.944342 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 11:21:23.946635 24568 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:23.945843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42326 (local address 127.12.175.193:38083)
0812 11:21:23.945918 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.945922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.946087 (+ 165us) server_negotiation.cc:407] Connection header received
0812 11:21:23.946153 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.946155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.946186 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.946240 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.946557 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42326: BlockingRecv error: recv got EOF from 127.0.0.1:42326 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 11:21:23.946748 12991 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533654564615-12991-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.947630 12991 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:23.948405 12991 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:21:23 dist-test-slave-gjrz krb5kdc[23531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:21:23.955108 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:23.949055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42330 (local address 127.12.175.193:38083)
0812 11:21:23.949170 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:23.949173 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:23.949230 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:21:23.949319 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:23.949321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:23.949351 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:23.949401 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:23.949766 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.950215 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.950856 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:23.951054 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:23.951115 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:23.952870 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:23.952873 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:23.952874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:23.952895 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:23.954049 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.954337 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.954339 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.954340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.954400 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:23.954564 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:23.954565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:23.954566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:23.954687 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:23.954765 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:23.954895 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 11:21:23.954984 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:21:23.955858 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23740
I20260812 11:21:23.990247 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24021
I20260812 11:21:24.004201 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24289
I20260812 11:21:24.021427 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23554
2026-08-12T11:21:24Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2255 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:24 dist-test-slave-gjrz krb5kdc[24589](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:24 dist-test-slave-gjrz krb5kdc[24589](info): set up 2 sockets
Aug 12 11:21:24 dist-test-slave-gjrz krb5kdc[24589](info): commencing operation
krb5kdc: starting...
W20260812 11:21:25.216069 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:25Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab.
Entry for principal oryx/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab.
I20260812 11:21:25.327922 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:44183
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab
--principal=oryx/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:25.434913 24614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:25.435161 24614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:25.435216 24614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:25.439373 24614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:25.439419 24614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:25.439436 24614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:25.439451 24614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:25.439464 24614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:25.444360 24614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab
--principal=oryx/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:44183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:25.445165 24614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:25.445991 24614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:25.453744 24624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:25.453733 24623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:25.453733 24628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:25.453928 24614 server_base.cc:1034] running on GCE node
I20260812 11:21:25.454516 24614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:25.455511 24614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:25.456668 24614 hybrid_clock.cc:648] HybridClock initialized: now 1786533685456636 us; error 43 us; skew 500 ppm
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:25.459179 24614 init.cc:377] Logged in from keytab as oryx/127.12.175.254@KRBTEST.COM (short username oryx)
I20260812 11:21:25.459985 24614 webserver.cc:460] Webserver started at http://127.12.175.254:37887/ using document root <none> and password file <none>
I20260812 11:21:25.460470 24614 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:25.460533 24614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:25.460716 24614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:25.462604 24614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "77fd2b64c3774d87a8c40f922b65cc35"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "ee424dda8dab3aac27757cd2dec5a3e9"
server_key_iv: "58574e16350662b0bc46c074955e1345"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.463102 24614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "77fd2b64c3774d87a8c40f922b65cc35"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "ee424dda8dab3aac27757cd2dec5a3e9"
server_key_iv: "58574e16350662b0bc46c074955e1345"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.466425 24614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:25.468577 24639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.469635 24614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:25.469754 24614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "77fd2b64c3774d87a8c40f922b65cc35"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "ee424dda8dab3aac27757cd2dec5a3e9"
server_key_iv: "58574e16350662b0bc46c074955e1345"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.469839 24614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:25.491236 24614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:25.494108 24614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:25.494266 24614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:25.501286 24614 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:44183
I20260812 11:21:25.501518 24733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:44183 every 8 connection(s)
I20260812 11:21:25.502161 24614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:25.503873 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24614
I20260812 11:21:25.503991 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:25.504254 12991 external_mini_cluster.cc:1428] Setting key c46867f0a78110860d5f56f8f4ef89c3
I20260812 11:21:25.504809 24735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:25.511638 24735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Bootstrap starting.
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:25.513743 24735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:25.514412 24735 log.cc:824] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:25.516426 24735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: No bootstrap required, opened a new log
I20260812 11:21:25.517095 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:25.505469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52204 (local address 127.12.175.254:44183)
0812 11:21:25.505842 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:25.505860 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:25.505894 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:21:25.506478 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:25.506492 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:25.506793 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:25.507047 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:25.507908 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.508880 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.509995 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.510422 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.510526 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:25.513023 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:25.513027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:25.513039 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:25.513065 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:25.514503 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:25.514963 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:25.514969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:25.514974 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:25.515112 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:25.515395 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:25.515397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:25.515398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:25.515757 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:25.515889 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:25.516166 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 11:21:25.516410 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260812 11:21:25.519603 24735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } }
I20260812 11:21:25.519797 24735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:25.519855 24735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77fd2b64c3774d87a8c40f922b65cc35, State: Initialized, Role: FOLLOWER
I20260812 11:21:25.520227 24735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } }
I20260812 11:21:25.520360 24735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:25.520421 24735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:25.520519 24735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:25.521288 24735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } }
I20260812 11:21:25.521585 24735 leader_election.cc:302] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77fd2b64c3774d87a8c40f922b65cc35; no voters:
I20260812 11:21:25.521847 24735 leader_election.cc:288] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:25.521941 24747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:25.522166 24747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 LEADER]: Becoming Leader. State: Replica: 77fd2b64c3774d87a8c40f922b65cc35, State: Running, Role: LEADER
I20260812 11:21:25.522472 24747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } }
I20260812 11:21:25.522871 24735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:25.523918 24750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77fd2b64c3774d87a8c40f922b65cc35. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } }
I20260812 11:21:25.524044 24750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:25.524398 24749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } }
I20260812 11:21:25.525027 24749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:25.527323 24786 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:25.527390 24786 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:25.527449 24763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:25.528268 24763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:25.533658 24763 catalog_manager.cc:1347] Generated new cluster ID: a1c922269130450fa48b515c1e3d3a63
I20260812 11:21:25.533717 24763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:25.541579 24763 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:25.542651 24763 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:25.555716 24763 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Generated new TSK 0
I20260812 11:21:25.556401 24763 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab.
Entry for principal oryx/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab.
I20260812 11:21:25.585608 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:44183
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:25.691491 24793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:25.691699 24793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:25.691738 24793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:25.695634 24793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:25.695678 24793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:25.695742 24793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:25.700654 24793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:44183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:25.701519 24793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:25.702428 24793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:25.711102 24810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:25.711225 24809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:25.711344 24793 server_base.cc:1034] running on GCE node
W20260812 11:21:25.711114 24814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:25.711690 24793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:25.712198 24793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:25.713337 24793 hybrid_clock.cc:648] HybridClock initialized: now 1786533685713316 us; error 37 us; skew 500 ppm
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:25.715828 24793 init.cc:377] Logged in from keytab as oryx/127.12.175.193@KRBTEST.COM (short username oryx)
I20260812 11:21:25.716574 24793 webserver.cc:460] Webserver started at http://127.12.175.193:38627/ using document root <none> and password file <none>
I20260812 11:21:25.717059 24793 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:25.717123 24793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:25.717298 24793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:25.719149 24793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "519bbe956760416da4b25f855b2f724e"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "c43b73ef05424393bfa420508a9cf4e9"
server_key_iv: "fcef9280985e231065cdabd81c8697c2"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.719686 24793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "519bbe956760416da4b25f855b2f724e"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "c43b73ef05424393bfa420508a9cf4e9"
server_key_iv: "fcef9280985e231065cdabd81c8697c2"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.723030 24793 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:25.725322 24832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.726411 24793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:21:25.726516 24793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "519bbe956760416da4b25f855b2f724e"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "c43b73ef05424393bfa420508a9cf4e9"
server_key_iv: "fcef9280985e231065cdabd81c8697c2"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.726608 24793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:25.750797 24793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:25.753597 24793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:25.753760 24793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:25.754268 24793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:25.755020 24793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:25.755069 24793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.755118 24793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:25.755147 24793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.763255 24793 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:42393
I20260812 11:21:25.763340 25039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:42393 every 8 connection(s)
I20260812 11:21:25.764068 24793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:25.771081 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24793
I20260812 11:21:25.771206 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:25.771512 12991 external_mini_cluster.cc:1428] Setting key ee1159c52f6869b9958e0a7aa0b6dec3
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:25.776278 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:25.765625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:36267 (local address 127.12.175.254:44183)
0812 11:21:25.765762 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:25.765767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:25.766534 (+ 767us) server_negotiation.cc:407] Connection header received
0812 11:21:25.767812 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:25.767814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:25.767860 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:25.767922 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:25.768912 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.769442 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.770460 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.770669 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.770734 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:25.773055 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:25.773059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:25.773061 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:25.773085 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:25.774419 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:25.774880 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:25.774883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:25.774885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:25.774963 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:25.775279 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:25.775283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:25.775285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:25.775458 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:25.775541 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:25.775998 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 11:21:25.776127 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:21:25.776957 25044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:25.765981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:36267)
0812 11:21:25.766401 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:25.766439 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:25.767619 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:25.768059 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:25.768065 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:25.768367 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:25.768802 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:25.768815 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.769534 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.769537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:25.770376 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:25.770384 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.770765 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.770768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:25.770915 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:25.771406 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:25.771421 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:25.772899 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:25.774527 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:25.774533 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:25.774554 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:25.774787 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:25.775044 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:25.775047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:25.775049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:25.775176 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:25.775562 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:25.775569 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:25.775785 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 11:21:25.775939 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 11:21:25.776222 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":112,"threads_started":1}
I20260812 11:21:25.778055 25041 heartbeater.cc:347] Connected to a master server at 127.12.175.254:44183
I20260812 11:21:25.778292 25041 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:25.778823 25041 heartbeater.cc:511] Master 127.12.175.254:44183 requested a full tablet report, sending...
I20260812 11:21:25.780452 24664 ts_manager.cc:194] Registered new tserver with Master: 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393)
WARNING: no policy specified for oryx/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:25.781912 24664 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:36267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab.
Entry for principal oryx/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab.
I20260812 11:21:25.796181 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:44183
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:25.900482 25049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:25.900683 25049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:25.900727 25049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:25.904589 25049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:25.904637 25049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:25.904704 25049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:25.909680 25049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:44183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:25.910482 25049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:25.911365 25049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:25.919895 25068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:25.919909 25061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:25.919909 25062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:25.919943 25049 server_base.cc:1034] running on GCE node
I20260812 11:21:25.920499 25049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:25.921032 25049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:25.922199 25049 hybrid_clock.cc:648] HybridClock initialized: now 1786533685922178 us; error 30 us; skew 500 ppm
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:25.924768 25049 init.cc:377] Logged in from keytab as oryx/127.12.175.194@KRBTEST.COM (short username oryx)
I20260812 11:21:25.925490 25049 webserver.cc:460] Webserver started at http://127.12.175.194:43981/ using document root <none> and password file <none>
I20260812 11:21:25.925971 25049 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:25.926034 25049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:25.926206 25049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:25.928025 25049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "0accec7eec8b4d14a30ee7f65bb13a42"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "6fec72a2e43a71c985e8a10a1a81598a"
server_key_iv: "a7645667b7ba298754b6e29211fa6f8e"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.928512 25049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "0accec7eec8b4d14a30ee7f65bb13a42"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "6fec72a2e43a71c985e8a10a1a81598a"
server_key_iv: "a7645667b7ba298754b6e29211fa6f8e"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.931977 25049 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:21:25.934054 25087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.935083 25049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:25.935194 25049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "0accec7eec8b4d14a30ee7f65bb13a42"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "6fec72a2e43a71c985e8a10a1a81598a"
server_key_iv: "a7645667b7ba298754b6e29211fa6f8e"
server_key_version: "encryptionkey@0"
I20260812 11:21:25.935292 25049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:25.955893 25049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:25.958276 25049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:25.958426 25049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:25.958910 25049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:25.959640 25049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:25.959684 25049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.959731 25049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:25.959760 25049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:25.967495 25049 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:42887
I20260812 11:21:25.967518 25308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:42887 every 8 connection(s)
I20260812 11:21:25.968276 25049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:25.971412 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 25049
I20260812 11:21:25.971522 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:25.971786 12991 external_mini_cluster.cc:1428] Setting key 45c65888ce105be3afc28b2030ab73a0
Aug 12 11:21:25 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:25.980515 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:25.969805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:36009 (local address 127.12.175.254:44183)
0812 11:21:25.969918 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:25.969922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:25.970646 (+ 724us) server_negotiation.cc:407] Connection header received
0812 11:21:25.971950 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:25.971953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:25.972014 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:25.972092 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:25.973308 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.973831 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.974953 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.975170 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.975254 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:25.977416 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:25.977419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:25.977420 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:25.977442 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:25.978675 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:25.979123 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:25.979126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:25.979127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:25.979200 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:25.979516 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:25.979519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:25.979521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:25.979696 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:25.979781 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:25.980247 (+ 466us) server_negotiation.cc:299] Negotiation successful
0812 11:21:25.980362 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
WARNING: no policy specified for oryx/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:21:25.981236 25311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:25.970091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:36009)
0812 11:21:25.970503 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:25.970543 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:25.971759 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:25.972270 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:25.972279 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:25.972648 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:25.973163 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:25.973179 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.973948 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.973951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:25.974833 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:25.974843 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:25.975319 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:25.975324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:25.975480 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:25.975955 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:25.975970 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:25.977268 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:25.978780 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:25.978785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:25.978798 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:25.979025 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:25.979299 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:25.979302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:25.979304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:25.979430 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:25.979795 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:25.979801 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:25.980012 (+ 211us) client_negotiation.cc:769] Sending connection context
0812 11:21:25.980165 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 11:21:25.980444 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260812 11:21:25.982235 25309 heartbeater.cc:347] Connected to a master server at 127.12.175.254:44183
I20260812 11:21:25.982441 25309 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:25.982897 25309 heartbeater.cc:511] Master 127.12.175.254:44183 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.195@KRBTEST.COM" created.
I20260812 11:21:25.983873 24664 ts_manager.cc:194] Registered new tserver with Master: 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194:42887)
I20260812 11:21:25.984405 24664 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:36009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab.
Entry for principal oryx/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab.
I20260812 11:21:25.996186 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:44183
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:26.103866 25319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:26.104080 25319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:26.104118 25319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:26.107890 25319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:26.107933 25319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:26.107985 25319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:26.112866 25319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:44183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:26.113713 25319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:26.114588 25319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:26.123881 25334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.123983 25319 server_base.cc:1034] running on GCE node
W20260812 11:21:26.124040 25335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.123924 25342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.124557 25319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:26.125145 25319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:26.126297 25319 hybrid_clock.cc:648] HybridClock initialized: now 1786533686126280 us; error 28 us; skew 500 ppm
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:26.131927 25319 init.cc:377] Logged in from keytab as oryx/127.12.175.195@KRBTEST.COM (short username oryx)
I20260812 11:21:26.132719 25319 webserver.cc:460] Webserver started at http://127.12.175.195:32923/ using document root <none> and password file <none>
I20260812 11:21:26.133203 25319 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.133261 25319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.133443 25319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:26.135339 25319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "4a892b4636414de4940c1cd2acfb7f96"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "47a89e48895b6db5b5bdb78becb55ee1"
server_key_iv: "873f925ca26d6cfe4eda938d6d2d2ca3"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.135869 25319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "4a892b4636414de4940c1cd2acfb7f96"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "47a89e48895b6db5b5bdb78becb55ee1"
server_key_iv: "873f925ca26d6cfe4eda938d6d2d2ca3"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.139349 25319 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:26.141589 25351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.142758 25319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:26.142870 25319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "4a892b4636414de4940c1cd2acfb7f96"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "47a89e48895b6db5b5bdb78becb55ee1"
server_key_iv: "873f925ca26d6cfe4eda938d6d2d2ca3"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.142956 25319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.159303 25319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:26.161865 25319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:26.162043 25319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:26.162544 25319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:26.163304 25319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:26.163350 25319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.163399 25319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:26.163427 25319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.171521 25319 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:42723
I20260812 11:21:26.171545 25565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:42723 every 8 connection(s)
I20260812 11:21:26.172410 25319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:26.181476 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 25319
I20260812 11:21:26.181581 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:26.181871 12991 external_mini_cluster.cc:1428] Setting key 6d82b462a371479f9f979da1c69f74cb
I20260812 11:21:26.184973 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.174095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:45721 (local address 127.12.175.254:44183)
0812 11:21:26.174243 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.174248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.175074 (+ 826us) server_negotiation.cc:407] Connection header received
0812 11:21:26.176383 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.176386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.176433 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.176510 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.177564 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.178071 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.179146 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.179399 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.179482 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.181769 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.181773 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.181776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.181805 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.183166 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.183636 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.183639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.183641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.183732 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.184067 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.184069 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.184070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.184243 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.184318 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.184774 (+ 456us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.184860 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:21:26.185734 25571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.174471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:45721)
0812 11:21:26.174910 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.174975 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.176191 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.176647 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.176654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.177001 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.177445 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.177459 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.178182 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.178185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.179055 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.179065 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.179525 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.179528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.179665 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.180163 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.180179 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.181553 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.183284 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.183290 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.183303 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.183546 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.183828 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.183831 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.183833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.183994 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.184369 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.184374 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.184588 (+ 214us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.184742 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.184995 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":113,"threads_started":1}
I20260812 11:21:26.186892 25568 heartbeater.cc:347] Connected to a master server at 127.12.175.254:44183
I20260812 11:21:26.187142 25568 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:26.187608 25568 heartbeater.cc:511] Master 127.12.175.254:44183 requested a full tablet report, sending...
I20260812 11:21:26.188563 24664 ts_manager.cc:194] Registered new tserver with Master: 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723)
I20260812 11:21:26.189076 24664 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:45721
I20260812 11:21:26.195650 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.253.keytab.
Entry for principal oryx/127.12.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.253.keytab.
I20260812 11:21:26.219774 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:36777
--webserver_interface=127.12.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.253.keytab
--principal=oryx/127.12.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44183,127.12.175.253:36777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:26.325105 25577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:26.325327 25577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:26.325380 25577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:26.329275 25577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:26.329322 25577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:26.329349 25577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:26.329383 25577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:26.329406 25577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:26.334431 25577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44183,127.12.175.253:36777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.253.keytab
--principal=oryx/127.12.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:36777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
W20260812 11:21:26.334611 25577 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.175.254:44183,127.12.175.253:36777'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 11:21:26.335359 25577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:26.336225 25577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:26.343923 25592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.343930 25587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.343932 25583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.344166 25577 server_base.cc:1034] running on GCE node
I20260812 11:21:26.344673 25577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:26.345659 25577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:26.346856 25577 hybrid_clock.cc:648] HybridClock initialized: now 1786533686346832 us; error 30 us; skew 500 ppm
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:26.350081 25577 init.cc:377] Logged in from keytab as oryx/127.12.175.253@KRBTEST.COM (short username oryx)
I20260812 11:21:26.351125 25577 webserver.cc:460] Webserver started at http://127.12.175.253:42429/ using document root <none> and password file <none>
I20260812 11:21:26.351821 25577 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.351913 25577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.352159 25577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:26.356716 25577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/instance:
uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "208c69e5f7d48caf079702b018137758"
server_key_iv: "62a3b03f6a04ebf9cca639508bda0cb9"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.357326 25577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal/instance:
uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "208c69e5f7d48caf079702b018137758"
server_key_iv: "62a3b03f6a04ebf9cca639508bda0cb9"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.361472 25577 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:21:26.365609 25607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.367400 25577 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:21:26.367529 25577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "208c69e5f7d48caf079702b018137758"
server_key_iv: "62a3b03f6a04ebf9cca639508bda0cb9"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.367635 25577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.380247 25577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:26.383805 25577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:26.383986 25577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:26.392678 25577 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.253:36777
I20260812 11:21:26.392875 25711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.253:36777 every 8 connection(s)
I20260812 11:21:26.393854 25577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
I20260812 11:21:26.396588 25713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:26.396682 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 25577
I20260812 11:21:26.401857 25713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.253@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:26.411602 25720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.398208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.12.175.253:36777)
0812 11:21:26.398614 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.398635 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.398681 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:21:26.399608 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.399634 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.400061 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.400437 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.401248 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.402294 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.403480 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.404148 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.404315 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.407051 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.407055 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.407064 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.407088 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.408672 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.409114 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.409119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.409124 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.409226 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.409513 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.409516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.409517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.409971 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.410157 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.410410 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.410687 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":110,"threads_started":1}
I20260812 11:21:26.412734 25722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.403567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52208)
0812 11:21:26.403927 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.403971 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.404078 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.404333 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.404338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.404681 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.404799 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.404805 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.405821 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.405824 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.406728 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.406739 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.407298 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.407302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.407403 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.407790 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.407805 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.409309 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.411035 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.411043 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.411047 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.411246 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.411683 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.411686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.411687 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.411783 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.412228 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.412233 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.412340 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.412476 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.412614 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":131,"threads_started":1}
I20260812 11:21:26.412791 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.403608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52208 (local address 127.12.175.254:44183)
0812 11:21:26.403716 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.403720 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.404047 (+ 327us) server_negotiation.cc:407] Connection header received
0812 11:21:26.404158 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.404161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.404210 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.404285 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.404921 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.405710 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.406844 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.407150 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.407224 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.409423 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.409426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.409428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.409452 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.410917 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.411495 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.411498 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.411500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.411594 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.411910 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.411913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.411914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.412130 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.412206 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.412537 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.412650 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:26.413798 25713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.253@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
I20260812 11:21:26.420717 25722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.414199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57068)
0812 11:21:26.414273 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.414283 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.414349 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.414534 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.414536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.414662 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.414736 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.414741 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.415407 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.415410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.415887 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.415894 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.416278 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.416281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.416387 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.416687 (+ 300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.416697 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.418180 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.419470 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.419473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.419474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.419639 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.419867 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.419870 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.419872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.419940 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.420247 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.420250 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.420327 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.420407 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.420529 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":16}
I20260812 11:21:26.420722 25720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.414285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57068 (local address 127.12.175.253:36777)
0812 11:21:26.414375 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.414379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.414402 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:21:26.414430 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.414432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.414459 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.414522 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.414834 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.415319 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.415985 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.416190 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.416270 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.418293 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.418296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.418299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.418318 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.419372 (+ 1054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.419720 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.419723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.419725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.419792 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.420014 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.420017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.420019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.420166 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.420246 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.420460 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.420579 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":35}
I20260812 11:21:26.423321 25713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Bootstrap starting.
I20260812 11:21:26.425513 25713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:26.426146 25713 log.cc:824] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:26.427798 25713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: No bootstrap required, opened a new log
I20260812 11:21:26.430630 25713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } }
I20260812 11:21:26.430805 25713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:26.430853 25713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198e4c90b85445ac8d6cc35a7dcd27f4, State: Initialized, Role: FOLLOWER
I20260812 11:21:26.431221 25713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } }
I20260812 11:21:26.431653 25726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } } }
I20260812 11:21:26.431762 25726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:26.432283 25713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:21:26.436297 25745 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:26.436362 25745 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:26.438323 25577 master_runner.cc:428] Detected that this master 198e4c90b85445ac8d6cc35a7dcd27f4 is joining an existing cluster
I20260812 11:21:26.438369 25577 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.175.253:36777
I20260812 11:21:26.448426 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.440220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52214 (local address 127.12.175.254:44183)
0812 11:21:26.440559 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.440564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.440580 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:21:26.440617 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.440620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.440664 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.440748 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.441202 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.442004 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.443034 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.443251 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.443365 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.444624 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.444628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.444630 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.444655 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.446129 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.447120 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.447123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.447125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.447204 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.447597 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.447600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.447602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.447809 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.447909 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.448172 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.448277 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258}
I20260812 11:21:26.448451 25720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.440713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57078 (local address 127.12.175.253:36777)
0812 11:21:26.440805 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.440809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.440821 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:26.440851 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.440853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.440886 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.440943 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.441351 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.441806 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.442919 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.443254 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.443386 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.445198 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.445203 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.445205 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.445231 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.446646 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.447309 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.447312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.447314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.447403 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.447685 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.447688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.447689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.447858 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.447934 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.448165 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.448302 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":28}
I20260812 11:21:26.448589 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.440220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57078)
0812 11:21:26.440525 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.440536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.440599 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.440987 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.440989 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.441168 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.441261 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.441267 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.441919 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.441922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.442796 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.442806 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.443502 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.443506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.443653 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.444605 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.444619 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.445047 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.446751 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.446754 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.446756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.447183 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.447495 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.447498 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.447501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.447595 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.447967 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.447970 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.448036 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.448216 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.448367 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":64,"spinlock_wait_cycles":27392,"thread_start_us":95,"threads_started":1}
I20260812 11:21:26.449208 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.440176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52214)
0812 11:21:26.440421 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.440435 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.440530 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.440791 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.440794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.440951 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.441083 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.441091 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.442104 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.442108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.442936 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.442943 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.443499 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.443503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.443708 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.444178 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.444194 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.444499 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.446752 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.446755 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.446757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.447041 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.447322 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.447324 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.447326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.447431 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.447902 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.447905 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.448003 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.448107 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.448468 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":75,"thread_start_us":85,"threads_started":1}
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.254@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
I20260812 11:21:26.460678 25720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.452853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57080 (local address 127.12.175.253:36777)
0812 11:21:26.452951 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.452955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.453298 (+ 343us) server_negotiation.cc:407] Connection header received
0812 11:21:26.453548 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.453552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.453604 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.453683 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.454460 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.454896 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.455758 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.455969 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.456049 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.457945 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.457949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.457951 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.457980 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.459118 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.459568 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.459571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.459573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.459642 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.459879 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.459883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.459884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.460063 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.460147 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.460448 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.460547 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:21:26.460705 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.452785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57080)
0812 11:21:26.453183 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.453231 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.453386 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.453822 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.453829 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.454251 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.454349 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.454355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.454991 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.454995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.455652 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.455662 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.456060 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.456064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.456163 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.456586 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.456596 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.457823 (+ 1227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.459213 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.459222 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.459227 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.459480 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.459721 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.459724 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.459726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.459802 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.460163 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.460170 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.460271 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.460385 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.460555 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":74,"threads_started":1}
I20260812 11:21:26.461844 24664 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.175.253:36777: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
member_type: NON_VOTER
last_known_addr {
host: "127.12.175.253"
port: 36777
}
attrs {
promote: true
}
}
dest_uuid: "77fd2b64c3774d87a8c40f922b65cc35"
cas_config_opid_index: -1
I20260812 11:21:26.462481 24664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } }
I20260812 11:21:26.464318 25762 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 198e4c90b85445ac8d6cc35a7dcd27f4 (127.12.175.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.464751 25665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:26.465811 25665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Refusing update from remote peer 77fd2b64c3774d87a8c40f922b65cc35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 11:21:26.466378 25759 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:26.468327 25762 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.175.253:36777
I20260812 11:21:26.468624 25762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.468683 25577 master.cc:537] Master@127.12.175.253:36777 shutting down...
I20260812 11:21:26.468720 25762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:26.472031 25665 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 198e4c90b85445ac8d6cc35a7dcd27f4 (127.12.175.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.473908 25778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.474027 25778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.474114 25778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.474167 25726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77fd2b64c3774d87a8c40f922b65cc35. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.474258 25726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.474187 25778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.475544 25577 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Raft consensus shutting down.
I20260812 11:21:26.475561 25773 mvcc.cc:205] Tried to move back new op lower bound from 7317641976032780288 to 7317641975900737536. Current Snapshot: MvccSnapshot[applied={T|T < 7317641975936618496}]
I20260812 11:21:26.475833 25577 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Raft consensus is shut down!
I20260812 11:21:26.475920 25577 tablet_replica.cc:330] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: stopping tablet replica
WARNING: no policy specified for oryx/127.12.175.252@KRBTEST.COM; defaulting to no policy
I20260812 11:21:26.484305 25577 master.cc:552] Master@127.12.175.253:36777 shutdown complete.
I20260812 11:21:26.484354 25577 master_runner.cc:305] Clearing existing system tablet
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.252@KRBTEST.COM" created.
I20260812 11:21:26.484571 25577 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.484625 25577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.485800 25577 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 11:21:26.486625 25785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.486820 25577 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.486946 25577 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:26.486979 25577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "208c69e5f7d48caf079702b018137758"
server_key_iv: "62a3b03f6a04ebf9cca639508bda0cb9"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.488636 25577 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:26.490840 25577 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:21:26.490927 25577 log.cc:1196] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 11:21:26.491214 25577 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Deleting consensus metadata
I20260812 11:21:26.491415 25577 master_runner.cc:315] Copying system tablet from 127.12.175.254:44183
I20260812 11:21:26.492471 25577 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: tablet copy: Beginning tablet copy session from remote peer at address 127.12.175.254:44183
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.252.keytab.
Entry for principal oryx/127.12.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.252.keytab.
I20260812 11:21:26.499509 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:35095
--webserver_interface=127.12.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.252.keytab
--principal=oryx/127.12.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:26.499883 25795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.492912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52228)
0812 11:21:26.493222 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.493233 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.493332 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.493554 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.493556 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.493706 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.493802 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.493808 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.494743 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.494746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.495462 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.495473 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.495887 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.495890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.495977 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.496450 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.496462 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.496746 (+ 284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.498317 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.498321 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.498323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.498576 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.498850 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.498853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.498855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.498944 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.499367 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.499370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.499470 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.499576 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.499708 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":75,"threads_started":1}
I20260812 11:21:26.500408 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.493008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52228 (local address 127.12.175.254:44183)
0812 11:21:26.493121 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.493125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.493303 (+ 178us) server_negotiation.cc:407] Connection header received
0812 11:21:26.493424 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.493428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.493476 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.493549 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.493907 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.494633 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.495562 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.495790 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.495875 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.496892 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.496895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.496898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.496922 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.498217 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.498672 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.498675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.498677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.498763 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.499032 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.499035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.499037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.499251 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.499382 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.499867 (+ 485us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.500267 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 11:21:26.501060 24706 tablet_copy_service.cc:140] P 77fd2b64c3774d87a8c40f922b65cc35: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 198e4c90b85445ac8d6cc35a7dcd27f4 ({username='oryx', principal='oryx/127.12.175.253@KRBTEST.COM'} at 127.0.0.1:52228)
I20260812 11:21:26.501235 24706 tablet_copy_service.cc:161] P 77fd2b64c3774d87a8c40f922b65cc35: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 198e4c90b85445ac8d6cc35a7dcd27f4 at {username='oryx', principal='oryx/127.12.175.253@KRBTEST.COM'} at 127.0.0.1:52228: session id = 198e4c90b85445ac8d6cc35a7dcd27f4-00000000000000000000000000000000
I20260812 11:21:26.502791 24706 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:21:26.504274 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:21:26.506304 25577 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: tablet copy: Starting download of 0 data blocks...
I20260812 11:21:26.506462 25577 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: tablet copy: Starting download of 1 WAL segments...
I20260812 11:21:26.508060 25577 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:21:26.509886 24706 tablet_copy_service.cc:342] P 77fd2b64c3774d87a8c40f922b65cc35: Request end of tablet copy session 198e4c90b85445ac8d6cc35a7dcd27f4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.175.253@KRBTEST.COM'} at 127.0.0.1:52228
I20260812 11:21:26.509985 24706 tablet_copy_service.cc:433] P 77fd2b64c3774d87a8c40f922b65cc35: ending tablet copy session 198e4c90b85445ac8d6cc35a7dcd27f4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 198e4c90b85445ac8d6cc35a7dcd27f4
I20260812 11:21:26.516692 25577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:26.523659 25806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.524013 25577 server_base.cc:1034] running on GCE node
W20260812 11:21:26.524115 25804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.527411 25808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.527673 25577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:26.527951 25577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:26.529090 25577 hybrid_clock.cc:648] HybridClock initialized: now 1786533686529077 us; error 29 us; skew 500 ppm
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:26.530609 25577 init.cc:377] Logged in from keytab as oryx/127.12.175.253@KRBTEST.COM (short username oryx)
I20260812 11:21:26.531059 25577 webserver.cc:460] Webserver started at http://127.12.175.253:45447/ using document root <none> and password file <none>
I20260812 11:21:26.531234 25577 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.531294 25577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.532444 25577 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 11:21:26.533344 25820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.533594 25577 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 11:21:26.533667 25577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "208c69e5f7d48caf079702b018137758"
server_key_iv: "62a3b03f6a04ebf9cca639508bda0cb9"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.533738 25577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.557711 25577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:26.559764 25577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:26.564846 25577 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.253:36777
I20260812 11:21:26.564877 25934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.253:36777 every 8 connection(s)
I20260812 11:21:26.565447 25577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
I20260812 11:21:26.567219 25935 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:21:26.568257 25935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Bootstrap starting.
I20260812 11:21:26.575501 25935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:21:26.575760 25935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: Bootstrap complete.
I20260812 11:21:26.576272 25935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } }
I20260812 11:21:26.576395 25935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 198e4c90b85445ac8d6cc35a7dcd27f4, State: Initialized, Role: LEARNER
I20260812 11:21:26.576508 25935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } }
I20260812 11:21:26.576838 25942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } }
I20260812 11:21:26.576931 25935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:26.577049 25942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.580297 25961 catalog_manager.cc:1259] Loaded cluster ID: a1c922269130450fa48b515c1e3d3a63
I20260812 11:21:26.580356 25961 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: loading cluster ID for follower catalog manager: success
I20260812 11:21:26.582322 25961 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: acquiring CA information for follower catalog manager: success
I20260812 11:21:26.583607 25961 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:21:26.625154 25799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:26.625365 25799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:26.625417 25799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:26.629277 25799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:26.629325 25799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:26.629349 25799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:26.629371 25799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:26.629400 25799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:26.634416 25799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.252.keytab
--principal=oryx/127.12.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:35095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:26.635362 25799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:26.636268 25799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:26.643939 25969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.644021 25973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.643956 25979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.644138 25799 server_base.cc:1034] running on GCE node
I20260812 11:21:26.644771 25799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:26.645753 25799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:26.646909 25799 hybrid_clock.cc:648] HybridClock initialized: now 1786533686646879 us; error 43 us; skew 500 ppm
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:26.649513 25799 init.cc:377] Logged in from keytab as oryx/127.12.175.252@KRBTEST.COM (short username oryx)
I20260812 11:21:26.650260 25799 webserver.cc:460] Webserver started at http://127.12.175.252:43949/ using document root <none> and password file <none>
I20260812 11:21:26.650736 25799 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.650791 25799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.650938 25799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:26.652817 25799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/instance:
uuid: "4a67e10e381844e4aa7170e1aa126cc4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "2222c01d9192a82c17ca22db6741438d"
server_key_iv: "713dcf277b25ca8a0ff1cf35d5493bcb"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.653295 25799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal/instance:
uuid: "4a67e10e381844e4aa7170e1aa126cc4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "2222c01d9192a82c17ca22db6741438d"
server_key_iv: "713dcf277b25ca8a0ff1cf35d5493bcb"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.656714 25799 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260812 11:21:26.658947 25992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.660091 25799 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260812 11:21:26.660193 25799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
uuid: "4a67e10e381844e4aa7170e1aa126cc4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "2222c01d9192a82c17ca22db6741438d"
server_key_iv: "713dcf277b25ca8a0ff1cf35d5493bcb"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.660284 25799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.672524 25799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:26.675163 25799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:26.675338 25799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:26.682045 25799 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.252:35095
I20260812 11:21:26.682291 26094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.252:35095 every 8 connection(s)
I20260812 11:21:26.682891 25799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
I20260812 11:21:26.685498 26095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:26.687968 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 25799
I20260812 11:21:26.689260 26095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.252@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.175.252@KRBTEST.COM
I20260812 11:21:26.700525 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.691149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52236 (local address 127.12.175.254:44183)
0812 11:21:26.691303 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.691308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.691498 (+ 190us) server_negotiation.cc:407] Connection header received
0812 11:21:26.691641 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.691644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.691700 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.691777 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.692678 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.693456 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.694397 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.694618 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.694708 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.697000 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.697003 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.697005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.697028 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.698514 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.699059 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.699063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.699065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.699158 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.699523 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.699527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.699529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.699701 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.699787 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.700261 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.700373 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:21:26.701313 26101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.690989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52236)
0812 11:21:26.691374 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.691418 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.691535 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.691838 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.691845 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.692156 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.692540 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.692551 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.693563 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.693566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.694280 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.694288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.694802 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.694807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.694960 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.695467 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.695487 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.696856 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.698622 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.698631 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.698638 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.698956 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.699244 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.699247 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.699249 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.699431 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.699804 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.699811 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.700035 (+ 224us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.700169 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.700456 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":122,"threads_started":1}
I20260812 11:21:26.701315 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.689410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50820 (local address 127.12.175.252:35095)
0812 11:21:26.689800 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.689819 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.689861 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:21:26.690671 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.690694 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.690992 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.692117 (+ 1125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.692436 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.693677 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.694484 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.694946 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.695042 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.697401 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.697408 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.697420 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.697445 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.699017 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.699449 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.699454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.699455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.699530 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.699791 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.699794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.699796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.700042 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.700226 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.700441 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.700749 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":254,"spinlock_wait_cycles":9344,"thread_start_us":112,"threads_started":1}
I20260812 11:21:26.702472 26095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.252@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
I20260812 11:21:26.709553 26101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.702883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57084)
0812 11:21:26.703198 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.703210 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.703316 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.703551 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.703554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.703698 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.703784 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.703792 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.704651 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.704654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.705162 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.705170 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.705602 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.705606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.705695 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.706007 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.706016 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.707056 (+ 1040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.708423 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.708426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.708427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.708599 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.708829 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.708832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.708833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.708921 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.709218 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.709220 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.709289 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.709359 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.709448 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251}
I20260812 11:21:26.709601 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.702998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57084 (local address 127.12.175.253:36777)
0812 11:21:26.703216 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.703221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.703254 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:21:26.703405 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.703408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.703456 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.703528 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.703907 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.704552 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.705272 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.705507 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.705594 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.707188 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.707191 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.707192 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.707215 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.708334 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.708670 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.708672 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.708673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.708740 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.708993 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.708995 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.708996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.709151 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.709221 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.709393 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.709482 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":76,"threads_started":1}
I20260812 11:21:26.710263 26095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.252@KRBTEST.COM for oryx/127.12.175.252@KRBTEST.COM
I20260812 11:21:26.716761 26101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.710631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50836)
0812 11:21:26.710710 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.710719 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.710785 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.710963 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.710966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.711094 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.711152 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.711157 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.711833 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.711836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.712297 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.712304 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.712696 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.712700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.712770 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.713119 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.713130 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.714141 (+ 1011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.715545 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.715548 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.715550 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.715719 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.715944 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.715947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.715949 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.716021 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.716325 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.716328 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.716405 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.716488 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.716618 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 11:21:26.716789 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.710720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50836 (local address 127.12.175.252:35095)
0812 11:21:26.710808 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.710812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.710823 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:26.710850 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.710853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.710884 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.710942 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.711249 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.711740 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.712392 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.712606 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.712687 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.714254 (+ 1567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.714257 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.714260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.714279 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.715452 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.715798 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.715801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.715803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.715868 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.716095 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.716098 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.716100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.716241 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.716320 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.716544 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.716671 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":33}
I20260812 11:21:26.719540 26095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Bootstrap starting.
I20260812 11:21:26.721535 26095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:26.722219 26095 log.cc:824] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:26.723960 26095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: No bootstrap required, opened a new log
I20260812 11:21:26.726785 26095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } }
I20260812 11:21:26.726967 26095 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:26.727020 26095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a67e10e381844e4aa7170e1aa126cc4, State: Initialized, Role: FOLLOWER
I20260812 11:21:26.727428 26095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } }
I20260812 11:21:26.727836 26107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } } }
I20260812 11:21:26.727949 26107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:26.728500 26095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:21:26.732887 26137 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:26.732954 26137 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:26.735929 25799 master_runner.cc:428] Detected that this master 4a67e10e381844e4aa7170e1aa126cc4 is joining an existing cluster
I20260812 11:21:26.735976 25799 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.175.252:35095
I20260812 11:21:26.745062 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.738496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52244 (local address 127.12.175.254:44183)
0812 11:21:26.738605 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.738609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.738621 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:26.738653 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.738656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.738691 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.738754 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.739320 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.739823 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.740638 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.740930 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.741027 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.742002 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.742006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.742009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.742033 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.743373 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.743937 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.743941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.743943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.744046 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.744318 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.744322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.744323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.744492 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.744577 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.744822 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.744918 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:21:26.745059 26147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.737785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52244)
0812 11:21:26.738106 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.738119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.738201 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.738822 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.738825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.739074 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.739193 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.739199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.739922 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.739925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.740531 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.740539 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.741057 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.741061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.741147 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.741554 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.741566 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.741853 (+ 287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.743657 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.743660 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.743661 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.743840 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.744150 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.744153 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.744155 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.744233 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.744584 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.744587 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.744671 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.744756 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.744883 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":94,"threads_started":1}
I20260812 11:21:26.746524 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.737888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57098 (local address 127.12.175.253:36777)
0812 11:21:26.738036 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.738040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.738519 (+ 479us) server_negotiation.cc:407] Connection header received
0812 11:21:26.738619 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.738622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.738683 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.738770 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.739462 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.740230 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.741437 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.741800 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.741889 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.743174 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.743178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.743180 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.743203 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.744736 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.745210 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.745214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.745216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.745304 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.745614 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.745618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.745619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.745806 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.745890 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.746233 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.746347 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:21:26.747006 26149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.737848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57098)
0812 11:21:26.738426 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.738438 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.738542 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.738887 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.738890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.739148 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.739302 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.739312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.740372 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.740375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.741282 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.741294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.742041 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.742045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.742140 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.742612 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.742626 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.743028 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.744859 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.744862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.744864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.745102 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.745427 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.745430 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.745432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.745517 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.745963 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.745965 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.746065 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.746707 (+ 642us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.746838 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":87,"threads_started":1}
I20260812 11:21:26.752737 26147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.738194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50852)
0812 11:21:26.745314 (+ 7120us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.745325 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.745407 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.745687 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.745689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.745839 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.745933 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.745940 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.746810 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.746813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.747789 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.747801 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.748371 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.748374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.748461 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.749101 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.749114 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.749442 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.750817 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.750821 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.750822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.750990 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.751224 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.751227 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.751229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.751329 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.752313 (+ 984us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.752317 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.752394 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.752473 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.752595 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7069,"thread_start_us":88,"threads_started":1}
I20260812 11:21:26.753062 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.738294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50852 (local address 127.12.175.252:35095)
0812 11:21:26.738391 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.738405 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.745363 (+ 6958us) server_negotiation.cc:407] Connection header received
0812 11:21:26.745485 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.745488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.745535 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.745579 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.746044 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.746694 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.747903 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.748181 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.748252 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.749557 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.749561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.749563 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.749585 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.750722 (+ 1137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.751071 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.751075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.751077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.751147 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.752066 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.752069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.752070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.752220 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.752302 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.752862 (+ 560us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.752961 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533685, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.254@KRBTEST.COM for oryx/127.12.175.252@KRBTEST.COM
I20260812 11:21:26.754925 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24793
I20260812 11:21:26.757750 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.748949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50854)
0812 11:21:26.749056 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.749068 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.749129 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.749591 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.749595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.750025 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.750122 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.750334 (+ 212us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.751425 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.751429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.751940 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.751948 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.752520 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.752524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.752615 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.753515 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.753529 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.755095 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.756638 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.756641 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.756642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.756811 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.757040 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.757043 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.757044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.757106 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.757407 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.757409 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.757480 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.757537 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.757644 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 11:21:26.758157 26153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.749062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50854 (local address 127.12.175.252:35095)
0812 11:21:26.749322 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.749330 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.749341 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:26.749410 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.749413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.749458 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.750446 (+ 988us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.750547 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.751321 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.752035 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.752407 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.752500 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.755240 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.755244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.755246 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.755287 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.756538 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.756899 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.756902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.756903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.756967 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.757182 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.757184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.757185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.757318 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.757877 (+ 559us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.757945 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.758033 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":130,"threads_started":1}
I20260812 11:21:26.786389 24664 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.175.252:35095: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4"
member_type: NON_VOTER
last_known_addr {
host: "127.12.175.252"
port: 35095
}
attrs {
promote: true
}
}
dest_uuid: "77fd2b64c3774d87a8c40f922b65cc35"
cas_config_opid_index: 5
I20260812 11:21:26.787215 24664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } }
I20260812 11:21:26.789121 25759 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.790970 25759 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.175.252:35095
I20260812 11:21:26.792555 26046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:26.794277 25799 master.cc:537] Master@127.12.175.252:35095 shutting down...
I20260812 11:21:26.794296 26046 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Refusing update from remote peer 77fd2b64c3774d87a8c40f922b65cc35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:21:26.796360 25762 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:21:26.797696 24644 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260812 11:21:26.791193 25759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.798132 25759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:26.799237 24644 consensus_peers.cc:487] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 -> Peer 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252:35095): Couldn't send request to peer 4a67e10e381844e4aa7170e1aa126cc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 11:21:26.800850 25799 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:26.801162 25799 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:26.801257 25799 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: stopping tablet replica
I20260812 11:21:26.805264 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:42393
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:44183
--webserver_port=38627
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:26.807121 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.799524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57100)
0812 11:21:26.799644 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.799660 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.799743 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.800274 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.800277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.800294 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:26.800381 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.800386 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.801377 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.801380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.805543 (+ 4163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.805557 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.806673 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.806677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.806777 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.806828 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.806902 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.806979 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 11:21:26.807626 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.799807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.12.175.253:36777)
0812 11:21:26.799932 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.799936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.799949 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:26.800000 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.800003 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.800062 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.800148 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:26.800509 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.801247 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.805704 (+ 4457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.806323 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.806443 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.806597 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.807417 (+ 820us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.807507 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:26.808095 25882 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Refusing update from remote peer 77fd2b64c3774d87a8c40f922b65cc35: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:21:26.808495 25759 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 11:21:26.809567 25882 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.809808 25799 master.cc:552] Master@127.12.175.252:35095 shutdown complete.
I20260812 11:21:26.809846 25799 master_runner.cc:305] Clearing existing system tablet
I20260812 11:21:26.810113 25799 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.810163 25799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.811218 25942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77fd2b64c3774d87a8c40f922b65cc35. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.811360 25942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.811453 25942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: NON_VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: true } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.811522 25942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.812145 25799 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:26.812767 25759 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: attempting to promote NON_VOTER 198e4c90b85445ac8d6cc35a7dcd27f4 to VOTER
I20260812 11:21:26.812966 26166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.813153 25799 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.813261 25799 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:26.813192 25759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } }
I20260812 11:21:26.813292 25799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
uuid: "4a67e10e381844e4aa7170e1aa126cc4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "2222c01d9192a82c17ca22db6741438d"
server_key_iv: "713dcf277b25ca8a0ff1cf35d5493bcb"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.814741 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.814109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50868)
0812 11:21:26.814600 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.814670 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:35095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425}
I20260812 11:21:26.815212 25882 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 LEARNER]: Refusing update from remote peer 77fd2b64c3774d87a8c40f922b65cc35: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 11:21:26.815444 25799 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:26.815722 25768 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 11:21:26.816859 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.816623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50876)
0812 11:21:26.816747 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.816791 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:35095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 11:21:26.817461 24644 consensus_peers.cc:487] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 -> Peer 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252:35095): Couldn't send request to peer 4a67e10e381844e4aa7170e1aa126cc4. Status: Network error: Client connection negotiation failed: client connection to 127.12.175.252:35095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:21:26.817878 25799 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:21:26.817967 25799 log.cc:1196] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 11:21:26.818221 25799 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Deleting consensus metadata
I20260812 11:21:26.818384 25799 master_runner.cc:315] Copying system tablet from 127.12.175.254:44183
I20260812 11:21:26.818460 25768 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 198e4c90b85445ac8d6cc35a7dcd27f4 (127.12.175.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.819469 25799 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: tablet copy: Beginning tablet copy session from remote peer at address 127.12.175.254:44183
I20260812 11:21:26.819806 25882 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 198e4c90b85445ac8d6cc35a7dcd27f4 (127.12.175.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.821117 26161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.821229 26161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:26.822130 25768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.822239 25768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:26.822404 25768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.822494 25768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:26.832398 26186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.823089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52252)
0812 11:21:26.824407 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:26.824421 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:26.824521 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:26.824766 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:26.824769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:26.824996 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:26.825108 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.825115 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.826121 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.826125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.827016 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:26.827026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.827789 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.827793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:26.827887 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.828429 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:26.828443 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:26.828847 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:26.830786 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.830789 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.830791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.831041 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.831367 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:26.831371 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:26.831373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:26.831469 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:26.831884 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:26.831887 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:26.831987 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 11:21:26.832102 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 11:21:26.832234 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1246,"thread_start_us":69,"threads_started":1}
I20260812 11:21:26.832422 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:26.823171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52252 (local address 127.12.175.254:44183)
0812 11:21:26.823301 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:26.823305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:26.824494 (+ 1189us) server_negotiation.cc:407] Connection header received
0812 11:21:26.824615 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:26.824618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:26.824666 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:26.824740 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:26.825204 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.826010 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.827132 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:26.827673 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:26.827778 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:26.829044 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:26.829048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:26.829050 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:26.829077 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:26.830667 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.831139 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.831142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.831144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.831231 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:26.831568 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:26.831572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:26.831574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:26.831789 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:26.831888 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:26.832171 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 11:21:26.832283 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:21:26.833192 24706 tablet_copy_service.cc:140] P 77fd2b64c3774d87a8c40f922b65cc35: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4a67e10e381844e4aa7170e1aa126cc4 ({username='oryx', principal='oryx/127.12.175.252@KRBTEST.COM'} at 127.0.0.1:52252)
I20260812 11:21:26.833292 24706 tablet_copy_service.cc:161] P 77fd2b64c3774d87a8c40f922b65cc35: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4a67e10e381844e4aa7170e1aa126cc4 at {username='oryx', principal='oryx/127.12.175.252@KRBTEST.COM'} at 127.0.0.1:52252: session id = 4a67e10e381844e4aa7170e1aa126cc4-00000000000000000000000000000000
I20260812 11:21:26.834259 24706 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:21:26.835481 25799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:21:26.837566 25799 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: tablet copy: Starting download of 0 data blocks...
I20260812 11:21:26.837759 25799 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: tablet copy: Starting download of 1 WAL segments...
I20260812 11:21:26.839356 25799 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:21:26.841085 24706 tablet_copy_service.cc:342] P 77fd2b64c3774d87a8c40f922b65cc35: Request end of tablet copy session 4a67e10e381844e4aa7170e1aa126cc4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.175.252@KRBTEST.COM'} at 127.0.0.1:52252
I20260812 11:21:26.841158 24706 tablet_copy_service.cc:433] P 77fd2b64c3774d87a8c40f922b65cc35: ending tablet copy session 4a67e10e381844e4aa7170e1aa126cc4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4a67e10e381844e4aa7170e1aa126cc4
I20260812 11:21:26.847863 25799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:26.849442 26189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.849530 26187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.852212 25799 server_base.cc:1034] running on GCE node
W20260812 11:21:26.855443 26198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.855680 25799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:26.855971 25799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:26.857129 25799 hybrid_clock.cc:648] HybridClock initialized: now 1786533686857108 us; error 37 us; skew 500 ppm
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:26.858660 25799 init.cc:377] Logged in from keytab as oryx/127.12.175.252@KRBTEST.COM (short username oryx)
I20260812 11:21:26.859104 25799 webserver.cc:460] Webserver started at http://127.12.175.252:41949/ using document root <none> and password file <none>
I20260812 11:21:26.859330 25799 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.859375 25799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.860627 25799 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:26.861608 26211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.861922 25799 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:26.862015 25799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
uuid: "4a67e10e381844e4aa7170e1aa126cc4"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "2222c01d9192a82c17ca22db6741438d"
server_key_iv: "713dcf277b25ca8a0ff1cf35d5493bcb"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.862100 25799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.871307 25799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:26.873394 25799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:26.878058 25799 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.252:35095
I20260812 11:21:26.878166 26310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.252:35095 every 8 connection(s)
I20260812 11:21:26.878572 25799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
I20260812 11:21:26.880203 26311 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:21:26.881356 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Bootstrap starting.
I20260812 11:21:26.892037 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:21:26.892408 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Bootstrap complete.
I20260812 11:21:26.892992 26311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } }
I20260812 11:21:26.893199 26311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a67e10e381844e4aa7170e1aa126cc4, State: Initialized, Role: LEARNER
I20260812 11:21:26.893338 26311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } }
I20260812 11:21:26.893726 26319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:26.893864 26319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:26.893816 26311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:26.896807 26341 catalog_manager.cc:1259] Loaded cluster ID: a1c922269130450fa48b515c1e3d3a63
I20260812 11:21:26.896858 26341 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: loading cluster ID for follower catalog manager: success
I20260812 11:21:26.898908 26341 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: acquiring CA information for follower catalog manager: success
I20260812 11:21:26.900319 26341 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:21:26.935734 26158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:26.935935 26158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:26.935971 26158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:26.939924 26158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:26.939968 26158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:26.940023 26158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:26.945019 26158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:42393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=38627
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:26.945854 26158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:26.946697 26158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:26.955521 26351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.955597 26358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:26.955519 26349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:26.955761 26158 server_base.cc:1034] running on GCE node
I20260812 11:21:26.956161 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:26.956722 26158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:26.957880 26158 hybrid_clock.cc:648] HybridClock initialized: now 1786533686957857 us; error 31 us; skew 500 ppm
Aug 12 11:21:26 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:26.960398 26158 init.cc:377] Logged in from keytab as oryx/127.12.175.193@KRBTEST.COM (short username oryx)
I20260812 11:21:26.961139 26158 webserver.cc:460] Webserver started at http://127.12.175.193:38627/ using document root <none> and password file <none>
I20260812 11:21:26.961627 26158 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:26.961757 26158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:26.965256 26158 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:26.967058 26365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.968413 26158 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:26.968521 26158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "519bbe956760416da4b25f855b2f724e"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "c43b73ef05424393bfa420508a9cf4e9"
server_key_iv: "fcef9280985e231065cdabd81c8697c2"
server_key_version: "encryptionkey@0"
I20260812 11:21:26.969097 26158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:26.986119 25309 heartbeater.cc:503] Master 127.12.175.254:44183 was elected leader, sending a full tablet report...
I20260812 11:21:26.994072 26158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:26.996819 26158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:26.996948 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:26.997402 26158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:26.998148 26158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:26.998191 26158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:26.998229 26158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:26.998257 26158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.006469 26158 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:42393
I20260812 11:21:27.006500 26567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:42393 every 8 connection(s)
I20260812 11:21:27.007365 26158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:27.012847 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 26158
I20260812 11:21:27.013034 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 25049
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.252@KRBTEST.COM
I20260812 11:21:27.027083 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.008964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:55859 (local address 127.12.175.254:44183)
0812 11:21:27.009091 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.009095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.010108 (+ 1013us) server_negotiation.cc:407] Connection header received
0812 11:21:27.011179 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.011182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.011234 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.011308 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.012635 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.013435 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.015590 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.016010 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.016098 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.021130 (+ 5032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.021134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.021137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.021162 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.024240 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.025554 (+ 1314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.025558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.025559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.025636 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.025932 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.025935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.025936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.026101 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.026154 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.026803 (+ 649us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.026922 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:21:27.028548 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.010516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.12.175.193:36829)
0812 11:21:27.010778 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.010789 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.010943 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.011476 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.011482 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.011921 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.012470 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.012484 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.017285 (+ 4801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.017289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.017847 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.017855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.018290 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.018294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.018380 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.018966 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.018980 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.020942 (+ 1962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.026500 (+ 5558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.026503 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.026505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.026735 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.027039 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.027042 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.027043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.027418 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.027879 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.027882 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.027968 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.028072 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.028194 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":67,"spinlock_wait_cycles":59520,"thread_start_us":80,"threads_started":1}
I20260812 11:21:27.029047 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.010713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:36829 (local address 127.12.175.252:35095)
0812 11:21:27.010966 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.010971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.010986 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:21:27.011150 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.011153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.011209 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.011318 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.016383 (+ 5065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.017182 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.017955 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.018189 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.018277 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.021130 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.021134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.021137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.021162 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.025424 (+ 4262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.026836 (+ 1412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.026840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.026841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.026926 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.027530 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.027534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.027536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.027748 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.027826 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.028788 (+ 962us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.028893 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":85,"threads_started":1}
I20260812 11:21:27.028553 26575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.009457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:55859)
0812 11:21:27.009972 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.010011 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.010938 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.011480 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.011485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.011923 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.012477 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.012486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.013623 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.013627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.015418 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.015432 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.016309 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.016313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.016503 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.018821 (+ 2318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.018839 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.020942 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.024611 (+ 3669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.024616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.024626 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.024966 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.025728 (+ 762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.025731 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.025732 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.025853 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.026219 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.026225 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.026506 (+ 281us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.027252 (+ 746us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.027606 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":84,"spinlock_wait_cycles":6528,"thread_start_us":656,"threads_started":1}
I20260812 11:21:27.030764 26569 heartbeater.cc:347] Connected to a master server at 127.12.175.254:44183
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533686, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
I20260812 11:21:27.030994 26569 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.031550 26569 heartbeater.cc:511] Master 127.12.175.254:44183 requested a full tablet report, sending...
I20260812 11:21:27.032065 26568 heartbeater.cc:347] Connected to a master server at 127.12.175.252:35095
I20260812 11:21:27.032157 26568 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.032321 26568 heartbeater.cc:511] Master 127.12.175.252:35095 requested a full tablet report, sending...
I20260812 11:21:27.032999 24664 ts_manager.cc:194] Re-registered known tserver with Master: 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393)
I20260812 11:21:27.033437 26230 ts_manager.cc:194] Registered new tserver with Master: 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393)
I20260812 11:21:27.033707 24664 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:55859
I20260812 11:21:27.035063 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:42887
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:44183
--webserver_port=43981
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:27.036154 26576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.009457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.12.175.193:38215)
0812 11:21:27.010381 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.010395 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.010938 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.011478 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.011485 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.011923 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.012474 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.012486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.028046 (+ 15560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.028049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.028857 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.028869 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.029462 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.029472 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.029563 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.029940 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.029953 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.031231 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.034548 (+ 3317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.034551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.034553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.034777 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.035121 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.035124 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.035126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.035212 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.035695 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.035697 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.035769 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.035840 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.035974 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":82,"spinlock_wait_cycles":55040,"thread_start_us":163,"threads_started":1}
I20260812 11:21:27.036190 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.009155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:38215 (local address 127.12.175.253:36777)
0812 11:21:27.009269 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.009272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.010490 (+ 1218us) server_negotiation.cc:407] Connection header received
0812 11:21:27.011180 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.011183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.011240 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.011310 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.012621 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.013436 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.028995 (+ 15559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.029325 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.029438 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.031567 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.031571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.031574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.031603 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.034425 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.034895 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.034898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.034900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.034996 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.035345 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.035348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.035350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.035575 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.035638 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.035942 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.036057 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:21:27.036909 26570 heartbeater.cc:347] Connected to a master server at 127.12.175.253:36777
I20260812 11:21:27.037009 26570 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.037180 26570 heartbeater.cc:511] Master 127.12.175.253:36777 requested a full tablet report, sending...
I20260812 11:21:27.038051 25860 ts_manager.cc:194] Registered new tserver with Master: 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393)
W20260812 11:21:27.144281 26580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:27.144503 26580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:27.144541 26580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:27.148423 26580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:27.148470 26580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:27.148538 26580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:27.153473 26580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:42887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=43981
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:27.154338 26580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:27.155232 26580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:27.164026 26585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:27.164064 26588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:27.164276 26580 server_base.cc:1034] running on GCE node
W20260812 11:21:27.164084 26594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:27.164690 26580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:27.165247 26580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:27.166402 26580 hybrid_clock.cc:648] HybridClock initialized: now 1786533687166384 us; error 28 us; skew 500 ppm
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:27.168967 26580 init.cc:377] Logged in from keytab as oryx/127.12.175.194@KRBTEST.COM (short username oryx)
I20260812 11:21:27.169724 26580 webserver.cc:460] Webserver started at http://127.12.175.194:43981/ using document root <none> and password file <none>
I20260812 11:21:27.170192 26580 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:27.170261 26580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:27.173947 26580 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:21:27.175936 26609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.177080 26580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:27.177177 26580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "0accec7eec8b4d14a30ee7f65bb13a42"
format_stamp: "Formatted at 2026-08-12 11:21:25 on dist-test-slave-gjrz"
server_key: "6fec72a2e43a71c985e8a10a1a81598a"
server_key_iv: "a7645667b7ba298754b6e29211fa6f8e"
server_key_version: "encryptionkey@0"
I20260812 11:21:27.177701 26580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:27.190794 25568 heartbeater.cc:503] Master 127.12.175.254:44183 was elected leader, sending a full tablet report...
I20260812 11:21:27.192941 26580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:27.196297 26580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:27.196480 26580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:27.196638 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.193052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50892 (local address 127.12.175.252:35095)
0812 11:21:27.193164 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.193167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.193181 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:27.193264 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.193266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.193317 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.193392 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:27.193676 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.194258 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.195622 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.196131 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.196255 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.196397 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.196439 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.196518 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:21:27.196638 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.192920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50892)
0812 11:21:27.193074 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.193090 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.193180 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.193420 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.193422 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.193442 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:27.193555 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.193563 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.194370 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.194374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.195502 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.195515 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.196255 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.196259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.196343 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.196365 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.196428 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.196500 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 11:21:27.197077 26580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:27.197496 26257 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 11:21:27.197903 26580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:27.197853 26319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77fd2b64c3774d87a8c40f922b65cc35. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:27.197956 26580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.197983 26319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:21:27.198007 26580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:27.198031 26580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.206138 26580 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:42887
I20260812 11:21:27.206161 26846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:42887 every 8 connection(s)
I20260812 11:21:27.207026 26580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:27.211529 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 26580
I20260812 11:21:27.211715 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 25319
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.252@KRBTEST.COM
I20260812 11:21:27.230360 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.208570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:60023 (local address 127.12.175.254:44183)
0812 11:21:27.208703 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.208707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.209581 (+ 874us) server_negotiation.cc:407] Connection header received
0812 11:21:27.210658 (+ 1077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.210662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.210708 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.210755 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.217165 (+ 6410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.217719 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.219068 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.219347 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.219404 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.223090 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.223094 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.223097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.223122 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.224912 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.226635 (+ 1723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.226638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.226640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.226716 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.227007 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.227010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.227011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.227194 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.227251 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.230123 (+ 2872us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.230225 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:27.232045 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.208971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:60023)
0812 11:21:27.209440 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.209487 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.210456 (+ 969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.210928 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.210937 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.211439 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.217026 (+ 5587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.217043 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.217858 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.217860 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.218945 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.218955 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.219577 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.219580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.219750 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.221122 (+ 1372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.221141 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.222933 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.225941 (+ 3008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.225947 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.225960 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.226250 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.226809 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.226811 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.226812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.226929 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.227346 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.227351 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.227597 (+ 246us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.230912 (+ 3315us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.231197 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":25,"spinlock_wait_cycles":40192,"thread_start_us":148,"threads_started":1}
I20260812 11:21:27.232599 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.210036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39779 (local address 127.12.175.252:35095)
0812 11:21:27.210147 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.210151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.210277 (+ 126us) server_negotiation.cc:407] Connection header received
0812 11:21:27.210659 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.210662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.210708 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.210755 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.220430 (+ 9675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.220930 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.221978 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.222333 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.222406 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.227806 (+ 5400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.227809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.227812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.227834 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.229123 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.229500 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.229503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.229505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.229575 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.229793 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.229795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.229797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.229955 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.230011 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.232366 (+ 2355us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.232474 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:27.233115 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.209933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.12.175.194:39779)
0812 11:21:27.210189 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.210203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.210461 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.210928 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.210937 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.211464 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.220320 (+ 8856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.220329 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.221038 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.221041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.221817 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.221830 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.222624 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.222627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.222761 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.223841 (+ 1080us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.223880 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.226528 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.229236 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.229238 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.229240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.229421 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.229658 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.229661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.229662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.229724 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.230732 (+ 1008us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.230734 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.230812 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.232849 (+ 2037us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.232953 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":59,"spinlock_wait_cycles":20096,"thread_start_us":84,"threads_started":1}
I20260812 11:21:27.234606 26850 heartbeater.cc:347] Connected to a master server at 127.12.175.254:44183
I20260812 11:21:27.234829 26850 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.235335 26850 heartbeater.cc:511] Master 127.12.175.254:44183 requested a full tablet report, sending...
I20260812 11:21:27.236341 24664 ts_manager.cc:194] Re-registered known tserver with Master: 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194:42887)
I20260812 11:21:27.236920 24664 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:60023
I20260812 11:21:27.239864 26849 heartbeater.cc:347] Connected to a master server at 127.12.175.252:35095
I20260812 11:21:27.239953 26849 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.240134 26849 heartbeater.cc:511] Master 127.12.175.252:35095 requested a full tablet report, sending...
I20260812 11:21:27.240810 26230 ts_manager.cc:194] Registered new tserver with Master: 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194:42887)
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
I20260812 11:21:27.246577 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:42723
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:44183
--webserver_port=32923
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:27.247519 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.208971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.12.175.194:58189)
0812 11:21:27.209441 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.209488 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.210463 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.210947 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.210950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.211473 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.240382 (+ 28909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.240391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.241228 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.241231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.242121 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.242133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.242577 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.242581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.242679 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.243074 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.243087 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.244370 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.245871 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.245875 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.245877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.246093 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.246430 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.246433 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.246435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.246558 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.246991 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.246994 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.247108 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.247202 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.247362 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":86,"spinlock_wait_cycles":18816,"thread_start_us":104,"threads_started":1}
I20260812 11:21:27.247560 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.209187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:58189 (local address 127.12.175.253:36777)
0812 11:21:27.209313 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.209317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.209574 (+ 257us) server_negotiation.cc:407] Connection header received
0812 11:21:27.210645 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.210648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.210704 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.210777 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.240534 (+ 29757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.241124 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.242235 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.242454 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.242531 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.244502 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.244505 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.244507 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.244533 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.245765 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.246222 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.246225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.246227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.246314 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.246648 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.246652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.246670 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.246875 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.246969 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.247301 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.247420 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:21:27.248530 26852 heartbeater.cc:347] Connected to a master server at 127.12.175.253:36777
I20260812 11:21:27.248611 26852 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.248740 26852 heartbeater.cc:511] Master 127.12.175.253:36777 requested a full tablet report, sending...
I20260812 11:21:27.249447 25860 ts_manager.cc:194] Registered new tserver with Master: 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194:42887)
W20260812 11:21:27.355325 26859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:27.355532 26859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:27.355571 26859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:27.359324 26859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:27.359365 26859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:27.359417 26859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:27.364351 26859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:42723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=32923
--tserver_master_addrs=127.12.175.254:44183,127.12.175.253:36777,127.12.175.252:35095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:27.365157 26859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:27.365980 26859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:27.374738 26868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:27.374883 26859 server_base.cc:1034] running on GCE node
W20260812 11:21:27.374728 26870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:27.375025 26873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:27.375443 26859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:27.376015 26859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:27.377161 26859 hybrid_clock.cc:648] HybridClock initialized: now 1786533687377134 us; error 38 us; skew 500 ppm
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:27.379803 26859 init.cc:377] Logged in from keytab as oryx/127.12.175.195@KRBTEST.COM (short username oryx)
I20260812 11:21:27.380554 26859 webserver.cc:460] Webserver started at http://127.12.175.195:32923/ using document root <none> and password file <none>
I20260812 11:21:27.381048 26859 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:27.381121 26859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:27.384620 26859 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:27.386493 26885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.387611 26859 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:27.387705 26859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "4a892b4636414de4940c1cd2acfb7f96"
format_stamp: "Formatted at 2026-08-12 11:21:26 on dist-test-slave-gjrz"
server_key: "47a89e48895b6db5b5bdb78becb55ee1"
server_key_iv: "873f925ca26d6cfe4eda938d6d2d2ca3"
server_key_version: "encryptionkey@0"
I20260812 11:21:27.388162 26859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:27.417886 26859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:27.420608 26859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:27.420773 26859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:27.421272 26859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:27.422034 26859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:27.422079 26859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.422113 26859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:27.422142 26859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:27.430307 26859 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:42723
I20260812 11:21:27.430333 27114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:42723 every 8 connection(s)
I20260812 11:21:27.431159 26859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:27.433158 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 26859
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.252@KRBTEST.COM
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
Aug 12 11:21:27 dist-test-slave-gjrz krb5kdc[24589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533687, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.253@KRBTEST.COM
I20260812 11:21:27.446344 27141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.435168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52256 (local address 127.12.175.254:44183)
0812 11:21:27.436128 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.436133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.436145 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:27.436179 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.436182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.436223 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.437165 (+ 942us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.437258 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.437971 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439124 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.439494 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439917 (+ 423us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.441844 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.441847 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.441850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.441887 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.443724 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.444213 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.444216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.444218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.444306 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.444722 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.444725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.444727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.444999 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.445165 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.446052 (+ 887us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.446165 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":86,"threads_started":1}
I20260812 11:21:27.448519 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.434557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:39237 (local address 127.12.175.252:35095)
0812 11:21:27.434689 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.434693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.434862 (+ 169us) server_negotiation.cc:407] Connection header received
0812 11:21:27.435045 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.435048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.435119 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.435173 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.436940 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.437712 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439385 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.439706 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439774 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.443405 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.443408 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.443410 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.443434 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.445432 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.446359 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.446363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.446365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.446452 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.447216 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.447220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.447221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.447442 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.447514 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.448253 (+ 739us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.448374 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:21:27.450083 27138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.434196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.12.175.195:39237)
0812 11:21:27.434779 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.434793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.434925 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.435522 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.435531 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.436095 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.436775 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.436795 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.437887 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.437890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.439235 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.439245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.439949 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.440194 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.440784 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.440799 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.443224 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.445897 (+ 2673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.445903 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.445916 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.446247 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.446945 (+ 698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.446948 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.446950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.447118 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.447695 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.447701 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.447976 (+ 275us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.448876 (+ 900us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.449188 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":49,"spinlock_wait_cycles":3968,"thread_start_us":74,"threads_started":1}
I20260812 11:21:27.450562 27127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.433130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:33307)
0812 11:21:27.434168 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.434181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.434818 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.435595 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.435598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.436084 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.436835 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.436845 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.437882 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.437885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.439304 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.439313 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.439949 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.440189 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.440735 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.440755 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.443793 (+ 3038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.448541 (+ 4748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.448544 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.448546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.448767 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.449065 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.449068 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.449070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.449161 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.449629 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.449632 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.449724 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.449824 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.449947 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":963,"mutex_wait_us":700,"spinlock_wait_cycles":27008,"thread_start_us":159,"threads_started":1}
I20260812 11:21:27.451081 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.432742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:33307 (local address 127.12.175.254:44183)
0812 11:21:27.432886 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.432890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.434254 (+ 1364us) server_negotiation.cc:407] Connection header received
0812 11:21:27.435361 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.435364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.435415 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.435484 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.436985 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.437746 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439419 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.439697 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439783 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.443933 (+ 4150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.443937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.443940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.443963 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.447649 (+ 3686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.448868 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.448871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.448872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.448945 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.449271 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.449275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.449277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.449483 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.449577 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.450831 (+ 1254us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.450934 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:21:27.451989 27116 heartbeater.cc:347] Connected to a master server at 127.12.175.254:44183
I20260812 11:21:27.452195 27116 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.452391 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.435523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50896 (local address 127.12.175.252:35095)
0812 11:21:27.439446 (+ 3923us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.439450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.442356 (+ 2906us) server_negotiation.cc:407] Connection header received
0812 11:21:27.444393 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.444396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.444444 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.444502 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.445250 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.445970 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.447015 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.447352 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.447454 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.448837 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.448840 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.448843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.448866 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.450446 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.450909 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.450913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.450914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.450994 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.451306 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.451309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.451311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.451519 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.451644 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.452135 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.452244 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3848,"thread_start_us":69,"threads_started":1}
I20260812 11:21:27.449648 24664 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:21:27.452682 27116 heartbeater.cc:511] Master 127.12.175.254:44183 requested a full tablet report, sending...
I20260812 11:21:27.453140 27126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.433129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.12.175.195:48109)
0812 11:21:27.433685 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.433739 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.435907 (+ 2168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.438167 (+ 2260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.438170 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.438332 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:27.438436 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.438443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.440875 (+ 2432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.440878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.441654 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.441665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.442368 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.442372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.442468 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.443187 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:27.443202 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:27.444503 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:27.451576 (+ 7073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.451579 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.451581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.451802 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.452126 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:27.452129 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:27.452131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:27.452216 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:27.452676 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:27.452679 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:27.452765 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.452851 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.452970 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":650,"threads_started":1}
I20260812 11:21:27.453173 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.432832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:48109 (local address 127.12.175.253:36777)
0812 11:21:27.432965 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.432969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.433848 (+ 879us) server_negotiation.cc:407] Connection header received
0812 11:21:27.436542 (+ 2694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.436546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.436593 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.436669 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.440058 (+ 3389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.440736 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.441761 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.442077 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.442180 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.444651 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.444654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.444657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.444681 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.448413 (+ 3732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.451914 (+ 3501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.451917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.451919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.452002 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.452320 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.452324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.452326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.452537 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.452616 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.452936 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.453037 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":54}
I20260812 11:21:27.453166 27115 heartbeater.cc:347] Connected to a master server at 127.12.175.252:35095
I20260812 11:21:27.453240 27115 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.453393 27115 heartbeater.cc:511] Master 127.12.175.252:35095 requested a full tablet report, sending...
W20260812 11:21:27.453743 24664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:27.454206 27117 heartbeater.cc:347] Connected to a master server at 127.12.175.253:36777
I20260812 11:21:27.454289 27117 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:27.454453 27117 heartbeater.cc:511] Master 127.12.175.253:36777 requested a full tablet report, sending...
I20260812 11:21:27.454741 27140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.435116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57116 (local address 127.12.175.253:36777)
0812 11:21:27.435734 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.435738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.436306 (+ 568us) server_negotiation.cc:407] Connection header received
0812 11:21:27.436478 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.436481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.436531 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.436591 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.437466 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.438189 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.439514 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.439834 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.440773 (+ 939us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.443322 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.443327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.443329 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.443353 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.446922 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.453548 (+ 6626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.453551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.453553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.453627 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.453913 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.453916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.453918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.454083 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.454192 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.454439 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.454590 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":584,"server-negotiator.queue_time_us":548,"thread_start_us":86,"threads_started":1}
I20260812 11:21:27.455307 25860 ts_manager.cc:194] Registered new tserver with Master: 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723)
I20260812 11:21:27.455704 24675 ts_manager.cc:194] Re-registered known tserver with Master: 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723)
I20260812 11:21:27.456362 24675 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:33307
I20260812 11:21:27.456959 26230 ts_manager.cc:194] Registered new tserver with Master: 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723)
I20260812 11:21:27.457722 26185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: NON_VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: true } } }
I20260812 11:21:27.457844 26185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:27.460894 27154 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: attempting to promote NON_VOTER 4a67e10e381844e4aa7170e1aa126cc4 to VOTER
I20260812 11:21:27.461223 27154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } }
I20260812 11:21:27.463195 26257 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 LEARNER]: Refusing update from remote peer 77fd2b64c3774d87a8c40f922b65cc35: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 11:21:27.463622 27158 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 11:21:27.463963 25882 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Refusing update from remote peer 77fd2b64c3774d87a8c40f922b65cc35: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260812 11:21:27.464305 27158 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 11:21:27.465780 26185 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.466218 26257 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.466369 25882 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.467253 26185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.467374 26185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:27.467492 26185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.467568 26185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:27.467664 26185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.467732 26185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:27.467912 26319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.468015 26319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:27.468765 27174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77fd2b64c3774d87a8c40f922b65cc35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:27.468883 27174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:27.475529 27178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.470323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42393 (local address 127.0.0.1:45092)
0812 11:21:27.470782 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.470795 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.470887 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.471668 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.471671 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.471690 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:27.471780 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.471787 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.472802 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.472806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.474059 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.474070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.475116 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.475120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.475203 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.475224 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.475317 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.475387 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260812 11:21:27.475558 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.470771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45092 (local address 127.12.175.193:42393)
0812 11:21:27.471220 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.471233 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.471255 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:21:27.471364 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.471367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.471541 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.471696 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:27.471870 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.472666 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.474251 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.475009 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.475118 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.475249 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.475344 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.475434 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":73,"threads_started":1}
I20260812 11:21:27.475713 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.469823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42887 (local address 127.0.0.1:42608)
0812 11:21:27.469951 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.469966 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.470041 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.471460 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.471463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.471481 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:27.471572 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.471579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.473363 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.473367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.474336 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.474346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.475365 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.475370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.475452 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.475477 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.475522 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.475598 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":39}
I20260812 11:21:27.476070 27179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.470655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42723 (local address 127.0.0.1:51960)
0812 11:21:27.470901 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.470914 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.471003 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.471738 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.471741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.471755 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:27.471834 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.471840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.473199 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.473203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.474496 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.474506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.475522 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.475525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.475603 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.475623 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.475666 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.475720 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":154,"thread_start_us":99,"threads_started":1}
I20260812 11:21:27.476207 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.471036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51960 (local address 127.12.175.195:42723)
0812 11:21:27.471359 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.471370 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.471390 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:21:27.471453 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.471458 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.471625 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.471769 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:27.471920 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.473113 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.474611 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.475405 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.475818 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.475940 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.475988 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.476080 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":110,"threads_started":1}
I20260812 11:21:27.476486 27177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.470267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42608 (local address 127.12.175.194:42887)
0812 11:21:27.470988 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.471002 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.471024 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:21:27.471092 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.471096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.471314 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.471479 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:27.471914 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.473101 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.474453 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.475200 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.475903 (+ 703us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.476007 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.476047 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.476121 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":138,"threads_started":1}
I20260812 11:21:27.478555 26456 tablet_service.cc:1467] Processing CreateTablet for tablet b521a09002c847dcbebcbe7873e5eb17 (DEFAULT_TABLE table=test-table [id=11d41d14ef4c4c0ba34a6b7196f834f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:27.478870 26705 tablet_service.cc:1467] Processing CreateTablet for tablet b521a09002c847dcbebcbe7873e5eb17 (DEFAULT_TABLE table=test-table [id=11d41d14ef4c4c0ba34a6b7196f834f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:27.478864 26987 tablet_service.cc:1467] Processing CreateTablet for tablet b521a09002c847dcbebcbe7873e5eb17 (DEFAULT_TABLE table=test-table [id=11d41d14ef4c4c0ba34a6b7196f834f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:27.479506 26456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b521a09002c847dcbebcbe7873e5eb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:27.479903 26705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b521a09002c847dcbebcbe7873e5eb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:27.479984 26987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b521a09002c847dcbebcbe7873e5eb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:27.485996 27187 tablet_bootstrap.cc:492] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Bootstrap starting.
I20260812 11:21:27.487370 27189 tablet_bootstrap.cc:492] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Bootstrap starting.
I20260812 11:21:27.488148 27187 tablet_bootstrap.cc:654] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:27.488286 27192 tablet_bootstrap.cc:492] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Bootstrap starting.
I20260812 11:21:27.489006 27187 log.cc:824] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:27.489410 27189 tablet_bootstrap.cc:654] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:27.490034 27192 tablet_bootstrap.cc:654] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:27.490209 27189 log.cc:824] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:27.490774 27192 log.cc:824] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:27.491217 27187 tablet_bootstrap.cc:492] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: No bootstrap required, opened a new log
I20260812 11:21:27.491436 27187 ts_tablet_manager.cc:1397] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260812 11:21:27.492723 27192 tablet_bootstrap.cc:492] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: No bootstrap required, opened a new log
I20260812 11:21:27.492969 27192 ts_tablet_manager.cc:1397] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:21:27.493378 27189 tablet_bootstrap.cc:492] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: No bootstrap required, opened a new log
I20260812 11:21:27.493626 27189 ts_tablet_manager.cc:1397] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:21:27.496243 27187 raft_consensus.cc:348] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.497674 27192 raft_consensus.cc:348] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.498167 27192 raft_consensus.cc:374] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:27.498261 27192 raft_consensus.cc:729] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0accec7eec8b4d14a30ee7f65bb13a42, State: Initialized, Role: FOLLOWER
I20260812 11:21:27.498757 27192 consensus_queue.cc:260] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.500077 27192 ts_tablet_manager.cc:1428] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260812 11:21:27.502696 26850 heartbeater.cc:503] Master 127.12.175.254:44183 was elected leader, sending a full tablet report...
I20260812 11:21:27.505896 27189 raft_consensus.cc:348] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.506142 27189 raft_consensus.cc:374] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:27.506191 27189 raft_consensus.cc:729] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a892b4636414de4940c1cd2acfb7f96, State: Initialized, Role: FOLLOWER
I20260812 11:21:27.506624 27189 consensus_queue.cc:260] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.507441 27116 heartbeater.cc:503] Master 127.12.175.254:44183 was elected leader, sending a full tablet report...
I20260812 11:21:27.510313 27189 ts_tablet_manager.cc:1428] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260812 11:21:27.515316 27187 raft_consensus.cc:374] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:27.515407 27187 raft_consensus.cc:729] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 519bbe956760416da4b25f855b2f724e, State: Initialized, Role: FOLLOWER
I20260812 11:21:27.515833 27187 consensus_queue.cc:260] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.516439 26569 heartbeater.cc:503] Master 127.12.175.254:44183 was elected leader, sending a full tablet report...
I20260812 11:21:27.516752 27187 ts_tablet_manager.cc:1428] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Time spent starting tablet: real 0.025s user 0.004s sys 0.002s
W20260812 11:21:27.682763 27123 tablet.cc:2369] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:27.696199 27199 raft_consensus.cc:482] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:27.696380 27199 raft_consensus.cc:504] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.697546 27199 leader_election.cc:288] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194:42887), 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393)
I20260812 11:21:27.701004 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.697887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:52579 (local address 127.12.175.193:42393)
0812 11:21:27.698008 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.698013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.698031 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:21:27.698175 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.698178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.698220 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.698282 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:27.698539 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.699025 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.700080 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.700474 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.700579 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.700633 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.700807 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.700881 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:21:27.701012 27177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.697815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:55499 (local address 127.12.175.194:42887)
0812 11:21:27.697920 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.697924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.697988 (+ 64us) server_negotiation.cc:407] Connection header received
0812 11:21:27.698144 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.698147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.698187 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.698245 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:27.698487 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.698983 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.700101 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.700487 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.700596 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.700647 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.700828 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.700897 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:21:27.701020 27126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.697789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42393 (local address 127.12.175.195:52579)
0812 11:21:27.697979 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.697992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.698073 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.698306 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.698309 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.698323 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:27.698432 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.698438 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.699139 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.699142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.699957 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.699966 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.700584 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.700587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.700698 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.700716 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.700779 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.700846 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":10}
I20260812 11:21:27.701035 27138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.697711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42887 (local address 127.12.175.195:55499)
0812 11:21:27.697918 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:27.697931 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:27.698039 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:27.698262 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:27.698265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:27.698279 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:27.698391 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.698396 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.699086 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.699089 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.699973 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:27.699983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.700596 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.700600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:27.700722 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.700738 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:21:27.700801 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:27.700869 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":91}
I20260812 11:21:27.701582 26496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b521a09002c847dcbebcbe7873e5eb17" candidate_uuid: "4a892b4636414de4940c1cd2acfb7f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "519bbe956760416da4b25f855b2f724e" is_pre_election: true
I20260812 11:21:27.701835 26740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b521a09002c847dcbebcbe7873e5eb17" candidate_uuid: "4a892b4636414de4940c1cd2acfb7f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" is_pre_election: true
I20260812 11:21:27.701905 26496 raft_consensus.cc:2454] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a892b4636414de4940c1cd2acfb7f96 in term 0.
I20260812 11:21:27.702126 26740 raft_consensus.cc:2454] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a892b4636414de4940c1cd2acfb7f96 in term 0.
I20260812 11:21:27.702386 26886 leader_election.cc:302] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a892b4636414de4940c1cd2acfb7f96, 519bbe956760416da4b25f855b2f724e; no voters:
I20260812 11:21:27.702641 27199 raft_consensus.cc:2781] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:27.702721 27199 raft_consensus.cc:482] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:27.702768 27199 raft_consensus.cc:3037] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:27.703979 27199 raft_consensus.cc:504] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:27.704325 27199 leader_election.cc:288] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [CANDIDATE]: Term 1 election: Requested vote from peers 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194:42887), 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393)
I20260812 11:21:27.704614 26740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b521a09002c847dcbebcbe7873e5eb17" candidate_uuid: "4a892b4636414de4940c1cd2acfb7f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0accec7eec8b4d14a30ee7f65bb13a42"
I20260812 11:21:27.704660 26496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b521a09002c847dcbebcbe7873e5eb17" candidate_uuid: "4a892b4636414de4940c1cd2acfb7f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "519bbe956760416da4b25f855b2f724e"
I20260812 11:21:27.704736 26740 raft_consensus.cc:3037] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:27.704761 26496 raft_consensus.cc:3037] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:27.705647 26740 raft_consensus.cc:2454] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a892b4636414de4940c1cd2acfb7f96 in term 1.
I20260812 11:21:27.705703 26496 raft_consensus.cc:2454] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a892b4636414de4940c1cd2acfb7f96 in term 1.
I20260812 11:21:27.705932 26894 leader_election.cc:302] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0accec7eec8b4d14a30ee7f65bb13a42, 4a892b4636414de4940c1cd2acfb7f96; no voters:
I20260812 11:21:27.706102 27199 raft_consensus.cc:2781] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:27.706295 27199 raft_consensus.cc:686] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 LEADER]: Becoming Leader. State: Replica: 4a892b4636414de4940c1cd2acfb7f96, State: Running, Role: LEADER
I20260812 11:21:27.706748 27199 consensus_queue.cc:237] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
W20260812 11:21:27.708817 26853 tablet.cc:2369] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:27.709879 24675 catalog_manager.cc:5495] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "4a892b4636414de4940c1cd2acfb7f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } health_report { overall_health: HEALTHY } } }
W20260812 11:21:27.759738 26574 tablet.cc:2369] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:27.768601 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.765196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51964 (local address 127.12.175.195:42723)
0812 11:21:27.765325 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.765330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.765345 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:21:27.765482 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.765485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.765540 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.765623 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:27.765854 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.766356 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.767186 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.767442 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.767531 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.767821 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:27.768219 (+ 398us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:27.768322 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.768394 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.768453 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:27.774149 26740 raft_consensus.cc:1261] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Refusing update from remote peer 4a892b4636414de4940c1cd2acfb7f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:27.774175 26496 raft_consensus.cc:1261] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 1 FOLLOWER]: Refusing update from remote peer 4a892b4636414de4940c1cd2acfb7f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:27.774804 27201 consensus_queue.cc:1035] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:27.774973 27199 consensus_queue.cc:1035] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:27.781970 27208 mvcc.cc:205] Tried to move back new op lower bound from 7317641985115832320 to 7317641984849145856. Current Snapshot: MvccSnapshot[applied={T|T < 7317641985115832320}]
I20260812 11:21:27.784408 27217 mvcc.cc:205] Tried to move back new op lower bound from 7317641985115832320 to 7317641984849145856. Current Snapshot: MvccSnapshot[applied={T|T < 7317641985115832320}]
I20260812 11:21:27.787988 27209 mvcc.cc:205] Tried to move back new op lower bound from 7317641985115832320 to 7317641984849145856. Current Snapshot: MvccSnapshot[applied={T|T < 7317641985115832320}]
I20260812 11:21:27.790405 24664 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:27.790537 24664 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:27.794256 24664 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77fd2b64c3774d87a8c40f922b65cc35: Sending DeleteTablet for 3 replicas of tablet b521a09002c847dcbebcbe7873e5eb17
I20260812 11:21:27.795101 26456 tablet_service.cc:1514] Processing DeleteTablet for tablet b521a09002c847dcbebcbe7873e5eb17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:27 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:45092
I20260812 11:21:27.795147 26705 tablet_service.cc:1514] Processing DeleteTablet for tablet b521a09002c847dcbebcbe7873e5eb17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:27 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42608
I20260812 11:21:27.795820 26987 tablet_service.cc:1514] Processing DeleteTablet for tablet b521a09002c847dcbebcbe7873e5eb17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:27 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:51960
I20260812 11:21:27.796309 27229 tablet_replica.cc:330] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: stopping tablet replica
I20260812 11:21:27.796599 27229 raft_consensus.cc:2229] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:27.796880 27229 raft_consensus.cc:2258] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:27.798388 27229 ts_tablet_manager.cc:1905] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:27.799396 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24614
I20260812 11:21:27.814150 27229 ts_tablet_manager.cc:1918] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:27.814335 27229 log.cc:1196] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/b521a09002c847dcbebcbe7873e5eb17
I20260812 11:21:27.814751 27229 ts_tablet_manager.cc:1939] T b521a09002c847dcbebcbe7873e5eb17 P 519bbe956760416da4b25f855b2f724e: Deleting consensus metadata
I20260812 11:21:27.819409 27140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.796504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57126 (local address 127.12.175.253:36777)
0812 11:21:27.796624 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.796628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.797378 (+ 750us) server_negotiation.cc:407] Connection header received
0812 11:21:27.797565 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.797568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.797616 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.797667 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.798773 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.799583 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.812717 (+ 13134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.813203 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.813301 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.815844 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.815848 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.815851 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.815877 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.817591 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.818099 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.818103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.818105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.818188 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.818471 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.818474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.818476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.818677 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.818770 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.819117 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.819238 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:21:27.819826 27226 tablet_replica.cc:330] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: stopping tablet replica
I20260812 11:21:27.819983 27232 tablet_replica.cc:330] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: stopping tablet replica
I20260812 11:21:27.820338 27226 raft_consensus.cc:2229] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:27.820675 27232 raft_consensus.cc:2229] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:27.821089 27232 raft_consensus.cc:2258] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:27.821445 27226 raft_consensus.cc:2258] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:27.823223 27232 ts_tablet_manager.cc:1905] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:27.824604 27226 ts_tablet_manager.cc:1905] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:27.826016 27232 ts_tablet_manager.cc:1918] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:27.826253 27232 log.cc:1196] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/b521a09002c847dcbebcbe7873e5eb17
I20260812 11:21:27.826650 27232 ts_tablet_manager.cc:1939] T b521a09002c847dcbebcbe7873e5eb17 P 4a892b4636414de4940c1cd2acfb7f96: Deleting consensus metadata
I20260812 11:21:27.827332 27226 ts_tablet_manager.cc:1918] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:27.827447 27226 log.cc:1196] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/b521a09002c847dcbebcbe7873e5eb17
I20260812 11:21:27.827776 27226 ts_tablet_manager.cc:1939] T b521a09002c847dcbebcbe7873e5eb17 P 0accec7eec8b4d14a30ee7f65bb13a42: Deleting consensus metadata
W20260812 11:21:27.828064 26895 connection.cc:535] server connection from 127.0.0.1:51960 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 11:21:27.828651 26371 connection.cc:535] server connection from 127.0.0.1:45092 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 11:21:27.828779 26614 connection.cc:441] server connection from 127.0.0.1:42608 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42608 (request call id 1) could send its response
I20260812 11:21:27.829555 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.796814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.12.175.252:35095)
0812 11:21:27.796917 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.796921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.820694 (+ 23773us) server_negotiation.cc:407] Connection header received
0812 11:21:27.820868 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.820871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.820921 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.820975 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.821811 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.822590 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.823684 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.824021 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.824099 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.825634 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.825637 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.825640 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.825665 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.827315 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.827797 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.827801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.827803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.827892 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.828230 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.828233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.828235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.828448 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.828553 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.829280 (+ 727us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.829405 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:21:27.840480 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.831915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50916 (local address 127.12.175.252:35095)
0812 11:21:27.832009 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.832013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.832253 (+ 240us) server_negotiation.cc:407] Connection header received
0812 11:21:27.832395 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.832398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.832440 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.832486 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.833379 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.834047 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.835129 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.835503 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.835604 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.837196 (+ 1592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.837199 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.837202 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.837224 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.838824 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.839321 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.839324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.839326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.839407 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.839677 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.839680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.839682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.839880 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.840006 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.840227 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.840336 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:21:27.840592 27140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:27.831638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57136 (local address 127.12.175.253:36777)
0812 11:21:27.831733 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:27.831737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:27.832212 (+ 475us) server_negotiation.cc:407] Connection header received
0812 11:21:27.832386 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:27.832390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:27.832434 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:27.832510 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:27.833365 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.834197 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.835340 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:27.835573 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:27.835660 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:27.837496 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:27.837500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:27.837503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:27.837535 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:27.838774 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.839371 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.839375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.839377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.839467 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:27.839742 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:27.839745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:27.839747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:27.839927 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:27.840040 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:27.840368 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 11:21:27.840464 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 11:21:28.787299 27244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:28.786817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:44637)
0812 11:21:28.787073 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:28.787175 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":69,"threads_started":1}
W20260812 11:21:28.787724 26850 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:44183 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:28.787901 27246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:28.787386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:53987)
0812 11:21:28.787713 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:28.787805 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":79,"threads_started":1}
W20260812 11:21:28.788298 27116 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:44183 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:28.790439 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:28.790102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:57833)
0812 11:21:28.790293 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:28.790365 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":60,"threads_started":1}
W20260812 11:21:28.790697 26569 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:44183 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:29.294956 27249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77fd2b64c3774d87a8c40f922b65cc35)
I20260812 11:21:29.295169 27249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } }
I20260812 11:21:29.295955 27253 raft_consensus.cc:482] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77fd2b64c3774d87a8c40f922b65cc35)
I20260812 11:21:29.296118 27253 raft_consensus.cc:504] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } }
I20260812 11:21:29.296252 27249 leader_election.cc:288] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183), 198e4c90b85445ac8d6cc35a7dcd27f4 (127.12.175.253:36777)
I20260812 11:21:29.296782 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.296344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52682)
0812 11:21:29.296598 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.296677 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":51,"threads_started":1}
W20260812 11:21:29.296957 26219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:29.297096 27253 leader_election.cc:288] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183), 4a67e10e381844e4aa7170e1aa126cc4 (127.12.175.252:35095)
I20260812 11:21:29.297748 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.297188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52688)
0812 11:21:29.297595 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.297664 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":48,"threads_started":1}
W20260812 11:21:29.297958 25824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:29.298022 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.297652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52690)
0812 11:21:29.297925 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.297971 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218}
W20260812 11:21:29.298123 26219 leader_election.cc:334] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183): Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:29.298785 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.298546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52692)
0812 11:21:29.298673 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.298720 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 11:21:29.298883 25824 leader_election.cc:334] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183): Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:29.300817 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.296490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:36777 (local address 127.0.0.1:57148)
0812 11:21:29.296818 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.296832 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.296935 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.297331 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.297334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.297352 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.297457 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.297463 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.298468 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.298472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.299700 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.299712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.300540 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.300543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.300606 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.300626 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.300671 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.300724 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":21,"thread_start_us":54,"threads_started":1}
I20260812 11:21:29.300880 27262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.296564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57148 (local address 127.12.175.253:36777)
0812 11:21:29.296794 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.296798 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.297018 (+ 220us) server_negotiation.cc:407] Connection header received
0812 11:21:29.297078 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.297081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.297126 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.297201 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.297584 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.298338 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.299814 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.300440 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.300567 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.300616 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.300696 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.300764 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":167,"thread_start_us":54,"threads_started":1}
I20260812 11:21:29.301318 25882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a67e10e381844e4aa7170e1aa126cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" is_pre_election: true
I20260812 11:21:29.301478 25882 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a67e10e381844e4aa7170e1aa126cc4 in term 1.
I20260812 11:21:29.301797 26220 leader_election.cc:302] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 198e4c90b85445ac8d6cc35a7dcd27f4, 4a67e10e381844e4aa7170e1aa126cc4; no voters: 77fd2b64c3774d87a8c40f922b65cc35
I20260812 11:21:29.302135 27249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 11:21:29.302187 27249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77fd2b64c3774d87a8c40f922b65cc35)
I20260812 11:21:29.302227 27249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:21:29.302381 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.297449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:35095 (local address 127.0.0.1:50928)
0812 11:21:29.297758 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.297772 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.297858 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.298607 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.298610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.298628 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.298715 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.298722 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.299529 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.299533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.300744 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.300753 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.301993 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.301997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.302108 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.302126 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.302189 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.302258 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":4,"thread_start_us":61,"threads_started":1}
I20260812 11:21:29.302392 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.297740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50928 (local address 127.12.175.252:35095)
0812 11:21:29.298408 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.298418 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.298429 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:29.298467 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.298470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.298506 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.298584 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.298811 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.299421 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.300860 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.301889 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.301993 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.302037 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.302213 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.302277 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":607,"thread_start_us":90,"threads_started":1}
I20260812 11:21:29.302817 26257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4a67e10e381844e4aa7170e1aa126cc4" is_pre_election: true
I20260812 11:21:29.303339 27249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } }
I20260812 11:21:29.303560 26257 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 198e4c90b85445ac8d6cc35a7dcd27f4 in current term 2: Already voted for candidate 4a67e10e381844e4aa7170e1aa126cc4 in this term.
I20260812 11:21:29.303673 27249 leader_election.cc:288] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [CANDIDATE]: Term 2 election: Requested vote from peers 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183), 198e4c90b85445ac8d6cc35a7dcd27f4 (127.12.175.253:36777)
I20260812 11:21:29.303992 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.303762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52708)
0812 11:21:29.303878 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.303934 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 11:21:29.303972 25882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a67e10e381844e4aa7170e1aa126cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4"
I20260812 11:21:29.304026 25824 leader_election.cc:302] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 198e4c90b85445ac8d6cc35a7dcd27f4; no voters: 4a67e10e381844e4aa7170e1aa126cc4, 77fd2b64c3774d87a8c40f922b65cc35
I20260812 11:21:29.304075 25882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:21:29.305055 25882 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a67e10e381844e4aa7170e1aa126cc4 in term 2.
I20260812 11:21:29.305155 27253 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:21:29.305365 26220 leader_election.cc:302] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198e4c90b85445ac8d6cc35a7dcd27f4, 4a67e10e381844e4aa7170e1aa126cc4; no voters:
I20260812 11:21:29.305531 27249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:21:29.305702 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.305514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52722)
0812 11:21:29.305607 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.305656 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 11:21:29.305714 27249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [term 2 LEADER]: Becoming Leader. State: Replica: 4a67e10e381844e4aa7170e1aa126cc4, State: Running, Role: LEADER
W20260812 11:21:29.305784 26219 leader_election.cc:334] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183): Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
I20260812 11:21:29.305953 27249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } }
I20260812 11:21:29.306792 27273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a67e10e381844e4aa7170e1aa126cc4. Latest consensus state: current_term: 2 leader_uuid: "4a67e10e381844e4aa7170e1aa126cc4" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:29.306888 27273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:29.307161 27275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:29.309247 27275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:29.309603 27275 catalog_manager.cc:1259] Loaded cluster ID: a1c922269130450fa48b515c1e3d3a63
I20260812 11:21:29.309644 27275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:29.310096 27275 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:29.310441 27275 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Loaded TSK: 0
I20260812 11:21:29.311022 27275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:29.336493 26230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:29.339310 26230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:29.341809 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.341607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52750)
0812 11:21:29.341703 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.341755 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 11:21:29.341899 25882 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [term 2 FOLLOWER]: Refusing update from remote peer 4a67e10e381844e4aa7170e1aa126cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 11:21:29.342344 27273 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 11:21:29.342422 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.342233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.0.0.1:52764)
0812 11:21:29.342331 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.342373 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:21:29.342552 26219 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 -> Peer 77fd2b64c3774d87a8c40f922b65cc35 (127.12.175.254:44183): Couldn't send request to peer 77fd2b64c3774d87a8c40f922b65cc35. Status: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:21:29.343629 27253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a67e10e381844e4aa7170e1aa126cc4. Latest consensus state: current_term: 2 leader_uuid: "4a67e10e381844e4aa7170e1aa126cc4" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:29.343730 27253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:29.344687 27249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4a67e10e381844e4aa7170e1aa126cc4" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:29.344789 27249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:29.344997 27253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4a67e10e381844e4aa7170e1aa126cc4" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "77fd2b64c3774d87a8c40f922b65cc35" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44183 } } peers { permanent_uuid: "198e4c90b85445ac8d6cc35a7dcd27f4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 36777 } attrs { promote: false } } peers { permanent_uuid: "4a67e10e381844e4aa7170e1aa126cc4" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 35095 } attrs { promote: false } } }
I20260812 11:21:29.345104 27253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198e4c90b85445ac8d6cc35a7dcd27f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:21:29.353811 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.349937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42887 (local address 127.0.0.1:42624)
0812 11:21:29.350274 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.350287 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.350360 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.350788 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.350791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.350813 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.350974 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.350982 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.351862 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.351865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.352767 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.352775 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.353430 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.353434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.353521 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.353555 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.353628 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.353695 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":63,"spinlock_wait_cycles":3712}
I20260812 11:21:29.353843 27288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.350075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42624 (local address 127.12.175.194:42887)
0812 11:21:29.350576 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.350580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.350593 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:29.350636 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.350639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.350683 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.350867 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.351109 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.351761 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.352873 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.353315 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.353430 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.353481 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.353651 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.353719 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":74,"threads_started":1}
I20260812 11:21:29.354506 26705 tablet_service.cc:1467] Processing CreateTablet for tablet 0a9c3063cafb47e19775cba6bd2b57f9 (DEFAULT_TABLE table=test-table [id=94120711388b44c9b6e3273b1739902d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:29.354822 26705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a9c3063cafb47e19775cba6bd2b57f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:29.355458 27292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.350456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42723 (local address 127.0.0.1:51972)
0812 11:21:29.350680 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.350692 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.350772 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.352235 (+ 1463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.352238 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.352257 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.352349 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.352354 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.353262 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.353265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.354263 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.354273 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.355119 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.355121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.355191 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.355210 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.355301 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.355365 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":92,"threads_started":1}
I20260812 11:21:29.355509 27294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.350797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51972 (local address 127.12.175.195:42723)
0812 11:21:29.352011 (+ 1214us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.352016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.352028 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:29.352078 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.352081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.352125 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.352204 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.352453 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.353164 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.354405 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.355012 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.355130 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.355177 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.355306 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.355390 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1139,"thread_start_us":73,"threads_started":1}
I20260812 11:21:29.355990 26987 tablet_service.cc:1467] Processing CreateTablet for tablet 0a9c3063cafb47e19775cba6bd2b57f9 (DEFAULT_TABLE table=test-table [id=94120711388b44c9b6e3273b1739902d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:29.356230 26987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a9c3063cafb47e19775cba6bd2b57f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:29.357098 27295 tablet_bootstrap.cc:492] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: Bootstrap starting.
I20260812 11:21:29.358031 27295 tablet_bootstrap.cc:654] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:29.358091 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.350161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42393 (local address 127.0.0.1:45094)
0812 11:21:29.350295 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.350307 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.350390 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.350763 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.350766 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.350784 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.350986 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.350994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.351905 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.351908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.353044 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.353054 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.357720 (+ 4666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.357724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.357810 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.357832 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.357899 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.357962 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":78,"spinlock_wait_cycles":1408}
I20260812 11:21:29.358451 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.350275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45094 (local address 127.12.175.193:42393)
0812 11:21:29.350502 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.350507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.350520 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:29.350585 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.350588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.350636 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.350971 (+ 335us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.351085 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.351794 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.353182 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.357498 (+ 4316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.357615 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.357662 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.358237 (+ 575us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.358316 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":64,"threads_started":1}
I20260812 11:21:29.358695 27297 tablet_bootstrap.cc:492] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Bootstrap starting.
I20260812 11:21:29.358947 26456 tablet_service.cc:1467] Processing CreateTablet for tablet 0a9c3063cafb47e19775cba6bd2b57f9 (DEFAULT_TABLE table=test-table [id=94120711388b44c9b6e3273b1739902d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:29.359210 26456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a9c3063cafb47e19775cba6bd2b57f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:29.359580 27297 tablet_bootstrap.cc:654] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:29.360671 27295 tablet_bootstrap.cc:492] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: No bootstrap required, opened a new log
I20260812 11:21:29.360671 27297 tablet_bootstrap.cc:492] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: No bootstrap required, opened a new log
I20260812 11:21:29.360766 27297 ts_tablet_manager.cc:1397] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:29.360992 27295 ts_tablet_manager.cc:1397] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:21:29.361181 27297 raft_consensus.cc:348] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.361281 27297 raft_consensus.cc:374] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:29.361313 27297 raft_consensus.cc:729] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a892b4636414de4940c1cd2acfb7f96, State: Initialized, Role: FOLLOWER
I20260812 11:21:29.361423 27297 consensus_queue.cc:260] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.361459 27295 raft_consensus.cc:348] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.361552 27295 raft_consensus.cc:374] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:29.361588 27295 raft_consensus.cc:729] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0accec7eec8b4d14a30ee7f65bb13a42, State: Initialized, Role: FOLLOWER
I20260812 11:21:29.361739 27295 consensus_queue.cc:260] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.361800 27297 ts_tablet_manager.cc:1428] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:29.361835 27302 tablet_bootstrap.cc:492] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e: Bootstrap starting.
I20260812 11:21:29.362082 27295 ts_tablet_manager.cc:1428] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:29.364193 27302 tablet_bootstrap.cc:654] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:29.364668 27115 heartbeater.cc:503] Master 127.12.175.252:35095 was elected leader, sending a full tablet report...
I20260812 11:21:29.365239 27308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.362934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:34197)
0812 11:21:29.365093 (+ 2159us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.365147 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2095,"thread_start_us":97,"threads_started":1}
I20260812 11:21:29.365602 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.362498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:35503)
0812 11:21:29.365449 (+ 2951us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.365503 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2891,"thread_start_us":84,"threads_started":1}
I20260812 11:21:29.365643 27302 tablet_bootstrap.cc:492] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e: No bootstrap required, opened a new log
I20260812 11:21:29.365927 27302 ts_tablet_manager.cc:1397] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:21:29.366166 26849 heartbeater.cc:503] Master 127.12.175.252:35095 was elected leader, sending a full tablet report...
I20260812 11:21:29.366323 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.366117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:35819)
0812 11:21:29.366213 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.366264 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 11:21:29.366364 27302 raft_consensus.cc:348] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.366480 27302 raft_consensus.cc:374] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:29.366509 27302 raft_consensus.cc:729] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 519bbe956760416da4b25f855b2f724e, State: Initialized, Role: FOLLOWER
I20260812 11:21:29.366627 27302 consensus_queue.cc:260] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.366901 27302 ts_tablet_manager.cc:1428] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:29.367859 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.367192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:41951)
0812 11:21:29.367706 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.367760 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":101,"threads_started":1}
I20260812 11:21:29.368333 27308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.367732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:44719)
0812 11:21:29.368222 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.368271 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422}
I20260812 11:21:29.368609 26568 heartbeater.cc:503] Master 127.12.175.252:35095 was elected leader, sending a full tablet report...
I20260812 11:21:29.369022 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.368246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:41759)
0812 11:21:29.368913 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.368956 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":83,"threads_started":1}
I20260812 11:21:29.383119 27305 raft_consensus.cc:482] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:29.383203 27305 raft_consensus.cc:504] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.384080 27305 leader_election.cc:288] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393), 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723)
I20260812 11:21:29.387405 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.384294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:34563 (local address 127.12.175.193:42393)
0812 11:21:29.384406 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.384410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.384424 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:29.384483 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.384486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.384525 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.384597 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.384837 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.385287 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.386365 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.386889 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.386985 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.387017 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.387228 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.387310 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:21:29.387431 27308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.384211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42393 (local address 127.12.175.194:34563)
0812 11:21:29.384315 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.384327 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.384407 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.384620 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.384623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.384643 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.384745 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.384750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.385381 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.385384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.386248 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.386258 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.387016 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.387020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.387115 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.387140 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.387220 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.387319 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"spinlock_wait_cycles":768}
I20260812 11:21:29.387790 27294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.384418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:33769 (local address 127.12.175.195:42723)
0812 11:21:29.384511 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.384515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.384655 (+ 140us) server_negotiation.cc:407] Connection header received
0812 11:21:29.384756 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.384758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.384790 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.384844 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:29.385069 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.385506 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.386708 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.387223 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.387355 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.387399 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.387637 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.387709 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:29.387812 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.384269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42723 (local address 127.12.175.194:33769)
0812 11:21:29.384583 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.384593 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:29.384675 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:29.384861 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:29.384864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:29.384879 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:29.384976 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.384981 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.385602 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.385605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.386587 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:29.386597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.387351 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.387355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:29.387451 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.387475 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:29.387604 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 11:21:29.387675 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":91,"threads_started":1}
I20260812 11:21:29.387869 26496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9c3063cafb47e19775cba6bd2b57f9" candidate_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "519bbe956760416da4b25f855b2f724e" is_pre_election: true
I20260812 11:21:29.387988 26496 raft_consensus.cc:2454] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0accec7eec8b4d14a30ee7f65bb13a42 in term 0.
I20260812 11:21:29.388248 27029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9c3063cafb47e19775cba6bd2b57f9" candidate_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a892b4636414de4940c1cd2acfb7f96" is_pre_election: true
I20260812 11:21:29.388325 26610 leader_election.cc:302] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0accec7eec8b4d14a30ee7f65bb13a42, 519bbe956760416da4b25f855b2f724e; no voters:
I20260812 11:21:29.388411 27029 raft_consensus.cc:2454] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0accec7eec8b4d14a30ee7f65bb13a42 in term 0.
I20260812 11:21:29.388583 27305 raft_consensus.cc:2781] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:29.388640 27305 raft_consensus.cc:482] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:29.388677 27305 raft_consensus.cc:3037] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:29.389500 27305 raft_consensus.cc:504] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.389783 27305 leader_election.cc:288] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [CANDIDATE]: Term 1 election: Requested vote from peers 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393), 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723)
I20260812 11:21:29.390077 26496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9c3063cafb47e19775cba6bd2b57f9" candidate_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "519bbe956760416da4b25f855b2f724e"
I20260812 11:21:29.390105 27029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9c3063cafb47e19775cba6bd2b57f9" candidate_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a892b4636414de4940c1cd2acfb7f96"
I20260812 11:21:29.390172 26496 raft_consensus.cc:3037] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:29.390208 27029 raft_consensus.cc:3037] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:29.390949 26496 raft_consensus.cc:2454] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0accec7eec8b4d14a30ee7f65bb13a42 in term 1.
I20260812 11:21:29.391005 27029 raft_consensus.cc:2454] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0accec7eec8b4d14a30ee7f65bb13a42 in term 1.
I20260812 11:21:29.391186 26610 leader_election.cc:302] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0accec7eec8b4d14a30ee7f65bb13a42, 519bbe956760416da4b25f855b2f724e; no voters:
I20260812 11:21:29.391383 27305 raft_consensus.cc:2781] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:29.391564 27305 raft_consensus.cc:686] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 LEADER]: Becoming Leader. State: Replica: 0accec7eec8b4d14a30ee7f65bb13a42, State: Running, Role: LEADER
I20260812 11:21:29.391772 27305 consensus_queue.cc:237] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } }
I20260812 11:21:29.392122 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.391903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:59447)
0812 11:21:29.392036 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.392075 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 11:21:29.393710 26230 catalog_manager.cc:5495] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0accec7eec8b4d14a30ee7f65bb13a42 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0accec7eec8b4d14a30ee7f65bb13a42" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 42887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:29.403798 27288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.400701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42638 (local address 127.12.175.194:42887)
0812 11:21:29.400796 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:29.400799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:29.400811 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:29.400958 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:29.400960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:29.401003 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:29.401087 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:29.401307 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.401758 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.402558 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:29.402754 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:29.402834 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:29.403074 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:29.403482 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:29.403588 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:29.403654 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 11:21:29.403700 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:21:29.405855 26496 raft_consensus.cc:1261] T 0a9c3063cafb47e19775cba6bd2b57f9 P 519bbe956760416da4b25f855b2f724e [term 1 FOLLOWER]: Refusing update from remote peer 0accec7eec8b4d14a30ee7f65bb13a42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:29.406205 27029 raft_consensus.cc:1261] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Refusing update from remote peer 0accec7eec8b4d14a30ee7f65bb13a42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:29.406312 27316 consensus_queue.cc:1035] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "519bbe956760416da4b25f855b2f724e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 42393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:29.406638 27305 consensus_queue.cc:1035] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a892b4636414de4940c1cd2acfb7f96" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:29.407620 27314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.407386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:56025)
0812 11:21:29.407490 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.407547 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 11:21:29.408957 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.408747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:40761)
0812 11:21:29.408846 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.408898 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 11:21:29.411468 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.411177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.194:52747)
0812 11:21:29.411360 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.411410 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260812 11:21:29.412429 27314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.412079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.193:39417)
0812 11:21:29.412322 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.412370 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260812 11:21:29.412488 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.412270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44183 (local address 127.12.175.195:52727)
0812 11:21:29.412394 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.412435 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:21:29.418373 26244 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:29.418485 26244 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:29.421626 26244 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4a67e10e381844e4aa7170e1aa126cc4: Sending DeleteTablet for 3 replicas of tablet 0a9c3063cafb47e19775cba6bd2b57f9
I20260812 11:21:29.422343 26987 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a9c3063cafb47e19775cba6bd2b57f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:29 UTC) from {username='oryx', principal='oryx/127.12.175.252@KRBTEST.COM'} at 127.0.0.1:51972
I20260812 11:21:29.422369 26456 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a9c3063cafb47e19775cba6bd2b57f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:29 UTC) from {username='oryx', principal='oryx/127.12.175.252@KRBTEST.COM'} at 127.0.0.1:45094
I20260812 11:21:29.423063 26705 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a9c3063cafb47e19775cba6bd2b57f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:29 UTC) from {username='oryx', principal='oryx/127.12.175.252@KRBTEST.COM'} at 127.0.0.1:42624
I20260812 11:21:29.423103 27349 tablet_replica.cc:330] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: stopping tablet replica
I20260812 11:21:29.423213 27349 raft_consensus.cc:2229] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:29.423319 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 26158
I20260812 11:21:29.423341 27349 raft_consensus.cc:2258] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:29.436085 27349 ts_tablet_manager.cc:1905] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:29.438449 27349 ts_tablet_manager.cc:1918] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:29.438524 27349 log.cc:1196] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/0a9c3063cafb47e19775cba6bd2b57f9
I20260812 11:21:29.438735 27354 tablet_replica.cc:330] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: stopping tablet replica
I20260812 11:21:29.438763 27349 ts_tablet_manager.cc:1939] T 0a9c3063cafb47e19775cba6bd2b57f9 P 4a892b4636414de4940c1cd2acfb7f96: Deleting consensus metadata
I20260812 11:21:29.438918 27354 raft_consensus.cc:2229] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:29.439257 27354 raft_consensus.cc:2258] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:29.439457 26222 catalog_manager.cc:4841] TS 4a892b4636414de4940c1cd2acfb7f96 (127.12.175.195:42723): tablet 0a9c3063cafb47e19775cba6bd2b57f9 (table test-table [id=94120711388b44c9b6e3273b1739902d]) successfully deleted
I20260812 11:21:29.443991 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.443779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:42393 (local address 127.0.0.1:45108)
0812 11:21:29.443885 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.443932 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:42393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 11:21:29.443990 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 26580
I20260812 11:21:29.444098 27354 ts_tablet_manager.cc:1905] T 0a9c3063cafb47e19775cba6bd2b57f9 P 0accec7eec8b4d14a30ee7f65bb13a42: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:21:29.449748 26214 catalog_manager.cc:4584] TS 519bbe956760416da4b25f855b2f724e (127.12.175.193:42393): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0a9c3063cafb47e19775cba6bd2b57f9: Network error: Client connection negotiation failed: client connection to 127.12.175.193:42393: connect: Connection refused (error 111)
I20260812 11:21:29.460119 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 26859
I20260812 11:21:29.460253 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:29.460015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:42887 (local address 127.0.0.1:42652)
0812 11:21:29.460129 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:29.460176 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.194:42887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 11:21:29.474818 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 25577
I20260812 11:21:29.485739 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 25799
2026-08-12T11:21:29Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5466 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:29 dist-test-slave-gjrz krb5kdc[27360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:29 dist-test-slave-gjrz krb5kdc[27360](info): set up 2 sockets
Aug 12 11:21:29 dist-test-slave-gjrz krb5kdc[27360](info): commencing operation
krb5kdc: starting...
W20260812 11:21:30.684864 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:30 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab.
Entry for principal oryx/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab.
I20260812 11:21:30.796257 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:46161
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab
--principal=oryx/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:46161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:30.901684 27388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:30.901911 27388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:30.901955 27388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:30.905925 27388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:30.905970 27388 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:21:30.905985 27388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:30.906013 27388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:30.906049 27388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:30.906075 27388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:30.910966 27388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:46161
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.254.keytab
--principal=oryx/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:46161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:30.911824 27388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:30.912678 27388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:30.920284 27400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:30.920285 27399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:30.920394 27409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:30.920439 27388 server_base.cc:1034] running on GCE node
I20260812 11:21:30.921066 27388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:30.922024 27388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:30.923180 27388 hybrid_clock.cc:648] HybridClock initialized: now 1786533690923164 us; error 26 us; skew 500 ppm
Aug 12 11:21:30 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533690, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:30.925587 27388 init.cc:377] Logged in from keytab as oryx/127.12.175.254@KRBTEST.COM (short username oryx)
I20260812 11:21:30.926360 27388 webserver.cc:460] Webserver started at http://127.12.175.254:41467/ using document root <none> and password file <none>
I20260812 11:21:30.926837 27388 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:30.926899 27388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:30.927073 27388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:30.928925 27388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "f9445522d1f543dc8caa2c2672c3d218"
format_stamp: "Formatted at 2026-08-12 11:21:30 on dist-test-slave-gjrz"
server_key: "d21df76bf5c593aa5294c82a1ed538a5"
server_key_iv: "61286edf44e0f6ee1bd19ce1dc4a020f"
server_key_version: "encryptionkey@0"
I20260812 11:21:30.929435 27388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "f9445522d1f543dc8caa2c2672c3d218"
format_stamp: "Formatted at 2026-08-12 11:21:30 on dist-test-slave-gjrz"
server_key: "d21df76bf5c593aa5294c82a1ed538a5"
server_key_iv: "61286edf44e0f6ee1bd19ce1dc4a020f"
server_key_version: "encryptionkey@0"
I20260812 11:21:30.932718 27388 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:30.934749 27422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:30.935839 27388 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:30.935945 27388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "f9445522d1f543dc8caa2c2672c3d218"
format_stamp: "Formatted at 2026-08-12 11:21:30 on dist-test-slave-gjrz"
server_key: "d21df76bf5c593aa5294c82a1ed538a5"
server_key_iv: "61286edf44e0f6ee1bd19ce1dc4a020f"
server_key_version: "encryptionkey@0"
I20260812 11:21:30.936025 27388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:30.954974 27388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:30.957283 27388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:30.957433 27388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:30.964443 27388 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:46161
I20260812 11:21:30.964452 27537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:46161 every 8 connection(s)
I20260812 11:21:30.965356 27388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:30.967924 27538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:30.970945 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 27388
I20260812 11:21:30.971064 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:30.971356 12991 external_mini_cluster.cc:1428] Setting key f837dd41dfefb98078bee20034ff128f
I20260812 11:21:30.973295 27538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Bootstrap starting.
I20260812 11:21:30.975602 27538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:30.976276 27538 log.cc:824] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:30.978194 27538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: No bootstrap required, opened a new log
Aug 12 11:21:30 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:30.981492 27538 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9445522d1f543dc8caa2c2672c3d218" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46161 } }
I20260812 11:21:30.981693 27538 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:30.981727 27538 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9445522d1f543dc8caa2c2672c3d218, State: Initialized, Role: FOLLOWER
I20260812 11:21:30.982157 27538 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9445522d1f543dc8caa2c2672c3d218" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46161 } }
I20260812 11:21:30.982321 27538 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:30.982388 27538 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:30.982479 27538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:30.983335 27538 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9445522d1f543dc8caa2c2672c3d218" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46161 } }
I20260812 11:21:30.983693 27538 leader_election.cc:302] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9445522d1f543dc8caa2c2672c3d218; no voters:
I20260812 11:21:30.984001 27538 leader_election.cc:288] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:30.984071 27552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:30.984267 27552 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [term 1 LEADER]: Becoming Leader. State: Replica: f9445522d1f543dc8caa2c2672c3d218, State: Running, Role: LEADER
I20260812 11:21:30.984561 27552 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9445522d1f543dc8caa2c2672c3d218" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46161 } }
I20260812 11:21:30.985080 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:30.972623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55732 (local address 127.12.175.254:46161)
0812 11:21:30.972991 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:30.973006 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:30.973043 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:21:30.973649 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:30.973665 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:30.973968 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:30.974223 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:30.975103 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:30.976189 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:30.977187 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:30.977628 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:30.977736 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:30.980306 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:30.980311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:30.980323 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:30.980349 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:30.981894 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:30.982344 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:30.982350 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:30.982356 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:30.982492 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:30.982786 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:30.982788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:30.982789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:30.983136 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:30.983314 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:30.983897 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 11:21:30.984197 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":101,"threads_started":1}
I20260812 11:21:30.985150 27538 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:30.987638 27554 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9445522d1f543dc8caa2c2672c3d218" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9445522d1f543dc8caa2c2672c3d218" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46161 } } }
I20260812 11:21:30.987670 27560 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9445522d1f543dc8caa2c2672c3d218. Latest consensus state: current_term: 1 leader_uuid: "f9445522d1f543dc8caa2c2672c3d218" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9445522d1f543dc8caa2c2672c3d218" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46161 } } }
I20260812 11:21:30.987958 27554 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:30.987962 27560 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218 [sys.catalog]: This master's current role is: LEADER
W20260812 11:21:30.989837 27590 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:21:30.989900 27590 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:21:30.990026 27592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:30.990900 27592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:30.996289 27592 catalog_manager.cc:1347] Generated new cluster ID: ff40c796655d4c17b83882b094c61ab5
I20260812 11:21:30.996371 27592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:31.016083 27592 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:31.016912 27592 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:31.021061 27592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Generated new TSK 0
I20260812 11:21:31.021633 27592 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab.
Entry for principal oryx/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab.
I20260812 11:21:31.052251 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:46161
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:31.159313 27605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:31.159535 27605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:31.159596 27605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:31.163424 27605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:31.163472 27605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:31.163522 27605 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:31.163581 27605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:31.168460 27605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:46161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:31.169340 27605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:31.170239 27605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:31.179075 27619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:31.179104 27628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:31.179068 27618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:31.179221 27605 server_base.cc:1034] running on GCE node
I20260812 11:21:31.179839 27605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:31.180392 27605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:31.181543 27605 hybrid_clock.cc:648] HybridClock initialized: now 1786533691181516 us; error 38 us; skew 500 ppm
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:31.184098 27605 init.cc:377] Logged in from keytab as oryx/127.12.175.193@KRBTEST.COM (short username oryx)
I20260812 11:21:31.184849 27605 webserver.cc:460] Webserver started at http://127.12.175.193:38751/ using document root <none> and password file <none>
I20260812 11:21:31.185338 27605 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:31.185398 27605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:31.185571 27605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:31.187507 27605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "0eb8025dab107939bc875a406f6dfa96"
server_key_iv: "495008854f5011a16ce1c4ca22ec5e21"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.187994 27605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "0eb8025dab107939bc875a406f6dfa96"
server_key_iv: "495008854f5011a16ce1c4ca22ec5e21"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.191296 27605 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:21:31.193511 27643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:31.194608 27605 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:31.194697 27605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "0eb8025dab107939bc875a406f6dfa96"
server_key_iv: "495008854f5011a16ce1c4ca22ec5e21"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.194792 27605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:31.232649 27605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:31.235198 27605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:31.235375 27605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:31.236713 27605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:31.236759 27605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:31.236797 27605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:31.236824 27605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:31.246622 27605 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:46193
I20260812 11:21:31.246661 27870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:46193 every 8 connection(s)
I20260812 11:21:31.247458 27605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:31.248246 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 27605
I20260812 11:21:31.248389 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:31.248741 12991 external_mini_cluster.cc:1428] Setting key 24922877813a531396ad706a4547d0bc
I20260812 11:21:31.250145 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.237525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:35675 (local address 127.12.175.254:46161)
0812 11:21:31.237635 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.237639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.238659 (+ 1020us) server_negotiation.cc:407] Connection header received
0812 11:21:31.239839 (+ 1180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.239842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.239900 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.240000 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.241356 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.242186 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.243791 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.244043 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.244131 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.246579 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.246583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.246586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.246613 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.248131 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.248671 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.248674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.248675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.248752 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.249082 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.249086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.249088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.249292 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.249380 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.249845 (+ 465us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.249981 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:31.250795 27662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.238015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.12.175.193:35675)
0812 11:21:31.238499 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.238566 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.239578 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.240173 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.240182 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.240585 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:31.241183 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.241202 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.242321 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.242325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.243679 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.243690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.244177 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.244182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.244346 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.244869 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:31.244887 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:31.246404 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:31.248227 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.248233 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.248245 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.248561 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.248844 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.248847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.248849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.248992 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.249434 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:31.249439 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:31.249638 (+ 199us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.249795 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.250061 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":135,"threads_started":1}
I20260812 11:21:31.252043 27871 heartbeater.cc:347] Connected to a master server at 127.12.175.254:46161
I20260812 11:21:31.252218 27871 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:31.252749 27871 heartbeater.cc:511] Master 127.12.175.254:46161 requested a full tablet report, sending...
I20260812 11:21:31.254246 27448 ts_manager.cc:194] Registered new tserver with Master: f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193)
I20260812 11:21:31.255676 27448 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:35675
WARNING: no policy specified for oryx/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:31.260823 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.254318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:58103 (local address 127.12.175.254:46161)
0812 11:21:31.254417 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.254420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.254434 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:31.254489 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.254492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.254528 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.254603 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.255093 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.255817 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.256865 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.257078 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.257150 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.258203 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.258206 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.258207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.258227 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.259428 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.259850 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.259852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.259854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.259915 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.260164 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.260165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.260166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.260304 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.260369 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.260614 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.260693 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:21:31.260885 27885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.254018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.12.175.193:58103)
0812 11:21:31.254325 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.254338 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.254417 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.254627 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.254630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.254822 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:31.254965 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.254975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.255941 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.255945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.256755 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.256766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.257181 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.257184 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.257272 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.257665 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:31.257679 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:31.258083 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:31.259524 (+ 1441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.259527 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.259529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.259755 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.259990 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.259993 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.259995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.260084 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.260388 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:31.260392 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:31.260483 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.260583 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.260701 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":131,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab.
Entry for principal oryx/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab.
I20260812 11:21:31.275702 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:46161
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:31.380503 27890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:31.380702 27890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:31.380739 27890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:31.384531 27890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:31.384575 27890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:31.384609 27890 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:31.384644 27890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:31.389571 27890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:46161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:31.390378 27890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:31.391196 27890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:31.399627 27896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:31.399627 27902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:31.399647 27899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:31.399857 27890 server_base.cc:1034] running on GCE node
I20260812 11:21:31.400214 27890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:31.400734 27890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:31.401901 27890 hybrid_clock.cc:648] HybridClock initialized: now 1786533691401878 us; error 31 us; skew 500 ppm
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:31.404349 27890 init.cc:377] Logged in from keytab as oryx/127.12.175.194@KRBTEST.COM (short username oryx)
I20260812 11:21:31.405088 27890 webserver.cc:460] Webserver started at http://127.12.175.194:46835/ using document root <none> and password file <none>
I20260812 11:21:31.405539 27890 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:31.405591 27890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:31.405737 27890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:31.407536 27890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "682de1daa12f454e8d774279b4782960"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "22599fe979f34f24918afc8f26468c5f"
server_key_iv: "558fa469ff4091e557196a35cfb23ec8"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.407992 27890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "682de1daa12f454e8d774279b4782960"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "22599fe979f34f24918afc8f26468c5f"
server_key_iv: "558fa469ff4091e557196a35cfb23ec8"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.411226 27890 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:31.413340 27916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:31.414369 27890 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:31.414467 27890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "682de1daa12f454e8d774279b4782960"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "22599fe979f34f24918afc8f26468c5f"
server_key_iv: "558fa469ff4091e557196a35cfb23ec8"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.414556 27890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:31.442840 27890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:31.445291 27890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:31.445451 27890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:31.446746 27890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:31.446794 27890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:31.446828 27890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:31.446842 27890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:31.457096 27890 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:41985
I20260812 11:21:31.457137 28151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:41985 every 8 connection(s)
I20260812 11:21:31.458035 27890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:31.459535 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.447473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:45467 (local address 127.12.175.254:46161)
0812 11:21:31.447617 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.447622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.448482 (+ 860us) server_negotiation.cc:407] Connection header received
0812 11:21:31.449582 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.449585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.449645 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.449738 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.450823 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.451545 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.452799 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.453076 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.453194 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.455948 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.455953 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.455956 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.455986 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.457479 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.457929 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.457933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.457935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.458027 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.458387 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.458391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.458393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.458616 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.458710 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.459290 (+ 580us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.459409 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:21:31.460216 27945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.447854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.12.175.194:45467)
0812 11:21:31.448318 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.448372 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.449351 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.449909 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.449917 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.450224 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:31.450656 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.450669 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.451725 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.451727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.452688 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.452700 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.453274 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.453280 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.453485 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.454055 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:31.454075 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:31.455791 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:31.457581 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.457586 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.457596 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.457823 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.458122 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.458125 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.458127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.458289 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.458765 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:31.458771 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:31.459031 (+ 260us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.459195 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.459466 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":111,"threads_started":1}
I20260812 11:21:31.461077 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 27890
I20260812 11:21:31.461215 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:31.461562 12991 external_mini_cluster.cc:1428] Setting key 0873b5c353d9650ebba0d6a50c6ca675
I20260812 11:21:31.461974 28153 heartbeater.cc:347] Connected to a master server at 127.12.175.254:46161
I20260812 11:21:31.462136 28153 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:31.462672 28153 heartbeater.cc:511] Master 127.12.175.254:46161 requested a full tablet report, sending...
I20260812 11:21:31.466035 27450 ts_manager.cc:194] Registered new tserver with Master: 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985)
I20260812 11:21:31.466629 27450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:45467
I20260812 11:21:31.470808 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.463658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:54281 (local address 127.12.175.254:46161)
0812 11:21:31.463751 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.463754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.464032 (+ 278us) server_negotiation.cc:407] Connection header received
0812 11:21:31.464121 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.464124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.464160 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.464218 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.464669 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.465148 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.466398 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.466682 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.466777 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.467997 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.468001 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.468004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.468027 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.469337 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.469786 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.469789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.469790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.469859 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.470116 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.470118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.470119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.470297 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.470367 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.470624 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.470704 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:21:31.470888 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.463594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.12.175.194:54281)
0812 11:21:31.463935 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.463948 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.464053 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.464257 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.464260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.464440 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:31.464561 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.464568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.465266 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.465269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.466281 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.466291 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.466891 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.466894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.466980 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.467456 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:31.467470 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:31.467846 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:31.469441 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.469445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.469447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.469693 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.469944 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.469947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.469949 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.470039 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.470380 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:31.470383 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:31.470484 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.470590 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.470721 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for oryx/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab.
Entry for principal oryx/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab.
I20260812 11:21:31.487994 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:46161
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:31.595120 28166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:31.595369 28166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:31.595413 28166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:31.599498 28166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:31.599543 28166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:31.599579 28166 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:21:31.599607 28166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:31.604501 28166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.175.254:46161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:31.605297 28166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:31.606122 28166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:31.614778 28182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:31.614782 28184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:31.614782 28193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:31.615003 28166 server_base.cc:1034] running on GCE node
I20260812 11:21:31.615646 28166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:31.616237 28166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:31.617393 28166 hybrid_clock.cc:648] HybridClock initialized: now 1786533691617380 us; error 32 us; skew 500 ppm
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:31.619961 28166 init.cc:377] Logged in from keytab as oryx/127.12.175.195@KRBTEST.COM (short username oryx)
I20260812 11:21:31.620764 28166 webserver.cc:460] Webserver started at http://127.12.175.195:33047/ using document root <none> and password file <none>
I20260812 11:21:31.621254 28166 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:31.621317 28166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:31.621500 28166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:31.623404 28166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "a0184701273547ce9356b651d84dad45"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "d826d04b3ec35098a5f18b1a1e88cf7f"
server_key_iv: "aaac4cf9bb6604e292ba86ea84dea894"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.623906 28166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "a0184701273547ce9356b651d84dad45"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "d826d04b3ec35098a5f18b1a1e88cf7f"
server_key_iv: "aaac4cf9bb6604e292ba86ea84dea894"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.627338 28166 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:21:31.629529 28203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:31.630604 28166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:31.630704 28166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "a0184701273547ce9356b651d84dad45"
format_stamp: "Formatted at 2026-08-12 11:21:31 on dist-test-slave-gjrz"
server_key: "d826d04b3ec35098a5f18b1a1e88cf7f"
server_key_iv: "aaac4cf9bb6604e292ba86ea84dea894"
server_key_version: "encryptionkey@0"
I20260812 11:21:31.630788 28166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:31.643499 28166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:31.646215 28166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:31.646373 28166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:31.647720 28166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:31.647768 28166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:31.647818 28166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:31.647846 28166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:31.658020 28166 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:34591
I20260812 11:21:31.658025 28448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:34591 every 8 connection(s)
I20260812 11:21:31.658946 28166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:31.660280 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.648313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:39189 (local address 127.12.175.254:46161)
0812 11:21:31.648425 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.648430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.649351 (+ 921us) server_negotiation.cc:407] Connection header received
0812 11:21:31.650217 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.650221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.650279 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.650349 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.651780 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.652664 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.654007 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.654299 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.654398 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.656727 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.656731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.656733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.656760 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.658220 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.658680 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.658684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.658686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.658823 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.659161 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.659165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.659167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.659430 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.659540 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.660065 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.660166 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:21:31.661018 28220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.648784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.12.175.195:39189)
0812 11:21:31.649216 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.649253 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.650018 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.650534 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.650543 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.650943 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:31.651604 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.651620 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.652794 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.652796 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.653880 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.653890 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.654467 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.654471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.654638 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.655119 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:31.655138 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:31.656568 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:31.658319 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.658323 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.658333 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.658566 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.658908 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.658910 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.658911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.659063 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.659594 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:31.659600 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:31.659846 (+ 246us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.659996 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.660214 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":126,"threads_started":1}
I20260812 11:21:31.662122 28449 heartbeater.cc:347] Connected to a master server at 127.12.175.254:46161
I20260812 11:21:31.662253 28449 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:31.662766 28449 heartbeater.cc:511] Master 127.12.175.254:46161 requested a full tablet report, sending...
I20260812 11:21:31.663313 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 28166
I20260812 11:21:31.663451 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:31.663784 12991 external_mini_cluster.cc:1428] Setting key f20cfa6114e97ab28fdba13034a2e555
I20260812 11:21:31.663866 27448 ts_manager.cc:194] Registered new tserver with Master: a0184701273547ce9356b651d84dad45 (127.12.175.195:34591)
I20260812 11:21:31.664528 27448 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:39189
I20260812 11:21:31.665678 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:21:31.670954 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.664489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:56337 (local address 127.12.175.254:46161)
0812 11:21:31.664591 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.664595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.664606 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:31.664632 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.664634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.664666 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.664725 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.665204 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.665911 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.666961 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.667172 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.667242 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.668249 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.668253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.668256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.668281 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.669613 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.670019 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.670021 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.670023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.670086 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.670325 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.670327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.670328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.670465 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.670532 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.670776 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.670854 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:21:31.671134 28462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.664163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.12.175.195:56337)
0812 11:21:31.664416 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.664430 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.664510 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.664755 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.664758 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.664966 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:31.665088 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.665096 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.666047 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.666051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.666834 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.666846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.667293 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.667297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.667380 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.667758 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:31.667772 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:31.668123 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:31.669714 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.669717 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.669719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.669929 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.670158 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:31.670161 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:31.670162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:31.670250 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:31.670543 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:31.670546 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:31.670634 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.670746 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.670889 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":91,"threads_started":1}
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:21:31.689569 27546 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:31.684088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55738 (local address 127.12.175.254:46161)
0812 11:21:31.684197 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.684201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.684213 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:31.684244 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.684246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.684276 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.684334 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.685002 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.685509 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.686334 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.686566 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.686646 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.689465 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55738: BlockingRecv error: recv got EOF from 127.0.0.1:55738 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 11:21:31 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533691, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:31.697456 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.690746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.12.175.254:46161)
0812 11:21:31.690844 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.690847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.690909 (+ 62us) server_negotiation.cc:407] Connection header received
0812 11:21:31.691035 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.691038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.691075 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.691140 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:31.691788 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.692243 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.692929 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.693191 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.693268 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.695156 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:31.695159 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:31.695161 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:31.695182 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:31.696257 (+ 1075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.696604 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.696607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.696608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.696670 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:31.696843 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:31.696845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:31.696846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:31.697008 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:31.697108 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.697257 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.697337 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 11:21:31.699911 27448 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:31.702767 27448 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:31.715380 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.710428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34591 (local address 127.0.0.1:37468)
0812 11:21:31.710711 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.710751 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.710859 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.711874 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.711880 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.711904 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:31.712055 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.712062 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.712986 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.712990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.713893 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.713903 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.714871 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.714875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.714986 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.715020 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.715121 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.715239 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":2,"spinlock_wait_cycles":1408,"thread_start_us":66,"threads_started":1}
I20260812 11:21:31.715387 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.710566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37468 (local address 127.12.175.195:34591)
0812 11:21:31.711423 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.711434 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.711466 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:21:31.711533 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.711539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.711731 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.711879 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:31.712183 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.712879 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.714014 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.714775 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.714902 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.715037 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.715147 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.715230 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765,"thread_start_us":122,"threads_started":1}
I20260812 11:21:31.716619 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.711074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:46193 (local address 127.0.0.1:39838)
0812 11:21:31.712101 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.712113 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.712202 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.712548 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.712551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.712567 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:31.712655 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.712662 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.713837 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.713840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.715003 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.715014 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.716243 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.716247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.716333 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.716354 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.716432 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.716498 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":969,"thread_start_us":83,"threads_started":1}
I20260812 11:21:31.716708 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.711486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39838 (local address 127.12.175.193:46193)
0812 11:21:31.711765 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.711784 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.712187 (+ 403us) server_negotiation.cc:407] Connection header received
0812 11:21:31.712302 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.712306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.712431 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.712555 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:31.712765 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.713681 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.715142 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.715921 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.716059 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.716175 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.716474 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.716574 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260812 11:21:31.716915 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.710703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41985 (local address 127.0.0.1:33122)
0812 11:21:31.711082 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:31.711094 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:31.711172 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:31.711911 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:31.711914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:31.711935 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:31.713048 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.713056 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.714416 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.714420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.715546 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:31.715557 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.716586 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.716590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:31.716670 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.716693 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:21:31.716742 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 11:21:31.716800 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":1001,"spinlock_wait_cycles":1792,"thread_start_us":82,"threads_started":1}
I20260812 11:21:31.718317 28309 tablet_service.cc:1467] Processing CreateTablet for tablet a8c2b94404e04cd0ba081b89a748ae88 (DEFAULT_TABLE table=test-table [id=faf26183542d444b933c4aa0a6895620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:31.719151 28309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c2b94404e04cd0ba081b89a748ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:31.718916 27730 tablet_service.cc:1467] Processing CreateTablet for tablet a8c2b94404e04cd0ba081b89a748ae88 (DEFAULT_TABLE table=test-table [id=faf26183542d444b933c4aa0a6895620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:31.719481 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:31.711138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33122 (local address 127.12.175.194:41985)
0812 11:21:31.711470 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:31.711481 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:31.711504 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:21:31.711576 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:31.711580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:31.711764 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:31.712048 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:31.713181 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.714288 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.715693 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:31.716466 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:31.717154 (+ 688us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:31.717278 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:31.717326 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 11:21:31.719346 (+ 2020us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":129,"threads_started":1}
I20260812 11:21:31.719812 27730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c2b94404e04cd0ba081b89a748ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:31.723901 28025 tablet_service.cc:1467] Processing CreateTablet for tablet a8c2b94404e04cd0ba081b89a748ae88 (DEFAULT_TABLE table=test-table [id=faf26183542d444b933c4aa0a6895620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:31.724874 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c2b94404e04cd0ba081b89a748ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:31.725405 28521 tablet_bootstrap.cc:492] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Bootstrap starting.
I20260812 11:21:31.727512 28521 tablet_bootstrap.cc:654] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:31.727617 28522 tablet_bootstrap.cc:492] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Bootstrap starting.
I20260812 11:21:31.728386 28521 log.cc:824] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:31.729600 28522 tablet_bootstrap.cc:654] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:31.730403 28521 tablet_bootstrap.cc:492] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: No bootstrap required, opened a new log
I20260812 11:21:31.730396 28522 log.cc:824] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:31.730600 28521 ts_tablet_manager.cc:1397] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:21:31.731770 28528 tablet_bootstrap.cc:492] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Bootstrap starting.
I20260812 11:21:31.732313 28522 tablet_bootstrap.cc:492] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: No bootstrap required, opened a new log
I20260812 11:21:31.732496 28522 ts_tablet_manager.cc:1397] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:21:31.733978 28528 tablet_bootstrap.cc:654] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:31.734350 28521 raft_consensus.cc:348] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:31.734614 28521 raft_consensus.cc:374] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:31.734671 28521 raft_consensus.cc:729] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0184701273547ce9356b651d84dad45, State: Initialized, Role: FOLLOWER
I20260812 11:21:31.734687 28528 log.cc:824] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:31.735101 28521 consensus_queue.cc:260] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:31.735772 28449 heartbeater.cc:503] Master 127.12.175.254:46161 was elected leader, sending a full tablet report...
I20260812 11:21:31.736392 28528 tablet_bootstrap.cc:492] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: No bootstrap required, opened a new log
I20260812 11:21:31.736263 28522 raft_consensus.cc:348] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:31.736485 28522 raft_consensus.cc:374] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:31.736544 28522 raft_consensus.cc:729] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d7bd5e0ad94e8095d2eecb39f3f489, State: Initialized, Role: FOLLOWER
I20260812 11:21:31.736562 28528 ts_tablet_manager.cc:1397] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:21:31.737099 28522 consensus_queue.cc:260] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:31.737219 28521 ts_tablet_manager.cc:1428] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:21:31.737708 27871 heartbeater.cc:503] Master 127.12.175.254:46161 was elected leader, sending a full tablet report...
I20260812 11:21:31.737989 28522 ts_tablet_manager.cc:1428] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:21:31.740260 28528 raft_consensus.cc:348] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:31.740506 28528 raft_consensus.cc:374] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:31.740573 28528 raft_consensus.cc:729] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682de1daa12f454e8d774279b4782960, State: Initialized, Role: FOLLOWER
I20260812 11:21:31.740988 28528 consensus_queue.cc:260] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:31.741530 28153 heartbeater.cc:503] Master 127.12.175.254:46161 was elected leader, sending a full tablet report...
I20260812 11:21:31.741750 28528 ts_tablet_manager.cc:1428] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260812 11:21:31.748349 27872 tablet.cc:2369] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:21:31.909940 28450 tablet.cc:2369] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:21:31.959060 28154 tablet.cc:2369] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:32.035714 28538 raft_consensus.cc:482] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:32.035908 28538 raft_consensus.cc:504] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:32.036972 28538 leader_election.cc:288] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0184701273547ce9356b651d84dad45 (127.12.175.195:34591), f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193)
I20260812 11:21:32.041628 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.037640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39621 (local address 127.12.175.193:46193)
0812 11:21:32.037773 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.037778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.037925 (+ 147us) server_negotiation.cc:407] Connection header received
0812 11:21:32.038030 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.038033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.038082 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.038153 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:32.038359 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.039101 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.040442 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.041052 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.041172 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.041224 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.041433 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.041501 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:32.041627 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.037289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:37851 (local address 127.12.175.195:34591)
0812 11:21:32.037434 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.037439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.037476 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:21:32.037658 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.037660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.037712 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.037785 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:32.038093 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.038903 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.040442 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.041062 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.041172 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.041224 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.041433 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.041502 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:21:32.041684 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.037170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34591 (local address 127.12.175.194:37851)
0812 11:21:32.037407 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.037419 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.037540 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.037824 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.037828 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.037850 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:32.037982 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.037989 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.039002 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.039005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.040326 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.040338 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.041167 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.041171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.041295 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.041345 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.041413 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.041518 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":40,"thread_start_us":72,"threads_started":1}
I20260812 11:21:32.041692 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.037508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:46193 (local address 127.12.175.194:39621)
0812 11:21:32.037843 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.037855 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.037943 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.038168 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.038170 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.038186 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:32.038269 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.038273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.039185 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.039189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.040326 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.040337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.041167 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.041171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.041305 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.041337 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.041413 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.041527 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":39,"thread_start_us":97,"threads_started":1}
I20260812 11:21:32.042320 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c2b94404e04cd0ba081b89a748ae88" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" is_pre_election: true
I20260812 11:21:32.042325 28359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c2b94404e04cd0ba081b89a748ae88" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0184701273547ce9356b651d84dad45" is_pre_election: true
I20260812 11:21:32.042623 27773 raft_consensus.cc:2454] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 0.
I20260812 11:21:32.042623 28359 raft_consensus.cc:2454] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 0.
I20260812 11:21:32.043068 27918 leader_election.cc:302] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, a0184701273547ce9356b651d84dad45; no voters:
I20260812 11:21:32.043313 28538 raft_consensus.cc:2781] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:32.043397 28538 raft_consensus.cc:482] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:32.043447 28538 raft_consensus.cc:3037] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.044421 28538 raft_consensus.cc:504] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:32.044715 28538 leader_election.cc:288] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 election: Requested vote from peers a0184701273547ce9356b651d84dad45 (127.12.175.195:34591), f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193)
I20260812 11:21:32.045058 28359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c2b94404e04cd0ba081b89a748ae88" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0184701273547ce9356b651d84dad45"
I20260812 11:21:32.045068 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c2b94404e04cd0ba081b89a748ae88" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
I20260812 11:21:32.045166 27773 raft_consensus.cc:3037] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.045172 28359 raft_consensus.cc:3037] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.046110 27773 raft_consensus.cc:2454] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 1.
I20260812 11:21:32.046376 27918 leader_election.cc:302] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, f9d7bd5e0ad94e8095d2eecb39f3f489; no voters:
I20260812 11:21:32.046608 28359 raft_consensus.cc:2454] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 1.
I20260812 11:21:32.046804 28538 raft_consensus.cc:2781] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:32.046969 28538 raft_consensus.cc:686] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 1 LEADER]: Becoming Leader. State: Replica: 682de1daa12f454e8d774279b4782960, State: Running, Role: LEADER
I20260812 11:21:32.047310 28538 consensus_queue.cc:237] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } }
I20260812 11:21:32.050055 27448 catalog_manager.cc:5495] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682de1daa12f454e8d774279b4782960 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "682de1daa12f454e8d774279b4782960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260812 11:21:32.071938 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.069072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33132 (local address 127.12.175.194:41985)
0812 11:21:32.069180 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.069183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.069195 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:32.069314 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.069316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.069362 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.069438 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.069598 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.070068 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.070788 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.070977 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.071048 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.071242 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.071649 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.071732 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.071779 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.071822 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:21:32.076992 27773 raft_consensus.cc:1261] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Refusing update from remote peer 682de1daa12f454e8d774279b4782960: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.077023 28359 raft_consensus.cc:1261] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Refusing update from remote peer 682de1daa12f454e8d774279b4782960: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.077579 28538 consensus_queue.cc:1035] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.077764 28549 consensus_queue.cc:1035] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.084489 28561 mvcc.cc:205] Tried to move back new op lower bound from 7317642002741465088 to 7317642002628108288. Current Snapshot: MvccSnapshot[applied={T|T < 7317642002741465088}]
I20260812 11:21:32.087792 28563 mvcc.cc:205] Tried to move back new op lower bound from 7317642002741465088 to 7317642002628108288. Current Snapshot: MvccSnapshot[applied={T|T < 7317642002741465088}]
I20260812 11:21:32.091624 27450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:32.091781 27450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:32.093977 27450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Sending DeleteTablet for 3 replicas of tablet a8c2b94404e04cd0ba081b89a748ae88
I20260812 11:21:32.094740 28025 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c2b94404e04cd0ba081b89a748ae88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:33122
I20260812 11:21:32.094853 28309 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c2b94404e04cd0ba081b89a748ae88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:37468
I20260812 11:21:32.095074 27730 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c2b94404e04cd0ba081b89a748ae88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:39838
I20260812 11:21:32.095206 28580 tablet_replica.cc:330] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: stopping tablet replica
I20260812 11:21:32.095504 28580 raft_consensus.cc:2229] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:32.095537 28586 tablet_replica.cc:330] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: stopping tablet replica
I20260812 11:21:32.095778 27450 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:21:32.095877 28580 raft_consensus.cc:2258] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.095880 28586 raft_consensus.cc:2229] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 11:21:32.096176 27450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:32.096194 28585 tablet_replica.cc:330] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: stopping tablet replica
I20260812 11:21:32.096441 28585 raft_consensus.cc:2229] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:32.096458 28586 raft_consensus.cc:2258] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.096712 28585 raft_consensus.cc:2258] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.098373 28580 ts_tablet_manager.cc:1905] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.099361 28586 ts_tablet_manager.cc:1905] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.100979 27730 tablet_service.cc:1467] Processing CreateTablet for tablet 18294a3644fc4fb8a9c306428aa6b086 (DEFAULT_TABLE table=test-table [id=b744c720af644e2ab480483b8b1c712c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.101409 27730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18294a3644fc4fb8a9c306428aa6b086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.101516 28025 tablet_service.cc:1467] Processing CreateTablet for tablet 18294a3644fc4fb8a9c306428aa6b086 (DEFAULT_TABLE table=test-table [id=b744c720af644e2ab480483b8b1c712c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.101742 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18294a3644fc4fb8a9c306428aa6b086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.103555 28586 ts_tablet_manager.cc:1918] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:32.103638 28586 log.cc:1196] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/a8c2b94404e04cd0ba081b89a748ae88
I20260812 11:21:32.103724 28522 tablet_bootstrap.cc:492] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Bootstrap starting.
I20260812 11:21:32.103825 28528 tablet_bootstrap.cc:492] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Bootstrap starting.
I20260812 11:21:32.103919 28586 ts_tablet_manager.cc:1939] T a8c2b94404e04cd0ba081b89a748ae88 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting consensus metadata
I20260812 11:21:32.105016 28528 tablet_bootstrap.cc:654] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.104987 27423 catalog_manager.cc:4841] TS f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193): tablet a8c2b94404e04cd0ba081b89a748ae88 (table test-table [id=faf26183542d444b933c4aa0a6895620]) successfully deleted
I20260812 11:21:32.105083 28522 tablet_bootstrap.cc:654] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.106506 28309 tablet_service.cc:1467] Processing CreateTablet for tablet 18294a3644fc4fb8a9c306428aa6b086 (DEFAULT_TABLE table=test-table [id=b744c720af644e2ab480483b8b1c712c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.106735 28522 tablet_bootstrap.cc:492] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: No bootstrap required, opened a new log
I20260812 11:21:32.106758 28309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18294a3644fc4fb8a9c306428aa6b086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.106808 28522 ts_tablet_manager.cc:1397] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:32.106875 28580 ts_tablet_manager.cc:1918] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:32.106953 28580 log.cc:1196] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/a8c2b94404e04cd0ba081b89a748ae88
I20260812 11:21:32.107226 28580 ts_tablet_manager.cc:1939] T a8c2b94404e04cd0ba081b89a748ae88 P 682de1daa12f454e8d774279b4782960: Deleting consensus metadata
I20260812 11:21:32.107204 28522 raft_consensus.cc:348] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.107326 28522 raft_consensus.cc:374] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.107362 28522 raft_consensus.cc:729] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d7bd5e0ad94e8095d2eecb39f3f489, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.107468 28522 consensus_queue.cc:260] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.107709 28522 ts_tablet_manager.cc:1428] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.108263 27424 catalog_manager.cc:4841] TS 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985): tablet a8c2b94404e04cd0ba081b89a748ae88 (table test-table [id=faf26183542d444b933c4aa0a6895620]) successfully deleted
I20260812 11:21:32.109536 28521 tablet_bootstrap.cc:492] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Bootstrap starting.
I20260812 11:21:32.109808 28585 ts_tablet_manager.cc:1905] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.110309 28521 tablet_bootstrap.cc:654] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.111887 28521 tablet_bootstrap.cc:492] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: No bootstrap required, opened a new log
I20260812 11:21:32.111961 28521 ts_tablet_manager.cc:1397] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:32.112075 28585 ts_tablet_manager.cc:1918] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:32.112166 28585 log.cc:1196] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/a8c2b94404e04cd0ba081b89a748ae88
I20260812 11:21:32.112344 28521 raft_consensus.cc:348] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.112432 28585 ts_tablet_manager.cc:1939] T a8c2b94404e04cd0ba081b89a748ae88 P a0184701273547ce9356b651d84dad45: Deleting consensus metadata
I20260812 11:21:32.112447 28521 raft_consensus.cc:374] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.112483 28521 raft_consensus.cc:729] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0184701273547ce9356b651d84dad45, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.112610 28521 consensus_queue.cc:260] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.112835 28521 ts_tablet_manager.cc:1428] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.113718 27423 catalog_manager.cc:4841] TS a0184701273547ce9356b651d84dad45 (127.12.175.195:34591): tablet a8c2b94404e04cd0ba081b89a748ae88 (table test-table [id=faf26183542d444b933c4aa0a6895620]) successfully deleted
I20260812 11:21:32.113958 28528 tablet_bootstrap.cc:492] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: No bootstrap required, opened a new log
I20260812 11:21:32.114042 28528 ts_tablet_manager.cc:1397] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260812 11:21:32.114406 28528 raft_consensus.cc:348] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.114494 28528 raft_consensus.cc:374] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.114514 28528 raft_consensus.cc:729] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682de1daa12f454e8d774279b4782960, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.114634 28528 consensus_queue.cc:260] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.114884 28528 ts_tablet_manager.cc:1428] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.159250 28532 raft_consensus.cc:482] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:32.159402 28532 raft_consensus.cc:504] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.160465 28532 leader_election.cc:288] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193), 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985)
I20260812 11:21:32.165169 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.160929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:56413 (local address 127.12.175.194:41985)
0812 11:21:32.161047 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.161052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.161341 (+ 289us) server_negotiation.cc:407] Connection header received
0812 11:21:32.161565 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.161569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.161619 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.161678 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:32.161956 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.162681 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.164164 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.164566 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.164673 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.164731 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.164956 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.165048 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:21:32.165212 28220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.160650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:46193 (local address 127.12.175.195:57477)
0812 11:21:32.160865 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.160880 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.160964 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.161374 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.161378 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.161419 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:32.161542 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.161549 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.162668 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.162671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.163994 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.164006 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.164860 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.164863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.164957 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.164977 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.165040 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.165106 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"spinlock_wait_cycles":18688}
I20260812 11:21:32.165272 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.160733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:57477 (local address 127.12.175.193:46193)
0812 11:21:32.161141 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.161145 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.161159 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:32.161212 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.161215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.161260 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.161341 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:32.161686 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.162476 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.164132 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.164745 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.164865 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.164915 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.165075 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.165148 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324}
I20260812 11:21:32.165601 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.160728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41985 (local address 127.12.175.195:56413)
0812 11:21:32.161259 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.161272 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.161432 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.161700 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.161703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.161718 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:32.161831 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.161837 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.162791 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.162794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.164033 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.164041 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.164696 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.164700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.164811 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.164836 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.165302 (+ 466us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.165462 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"spinlock_wait_cycles":6912,"thread_start_us":78,"threads_started":1}
I20260812 11:21:32.165856 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18294a3644fc4fb8a9c306428aa6b086" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" is_pre_election: true
I20260812 11:21:32.165990 27773 raft_consensus.cc:2454] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 0.
I20260812 11:21:32.166141 28056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18294a3644fc4fb8a9c306428aa6b086" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682de1daa12f454e8d774279b4782960" is_pre_election: true
I20260812 11:21:32.166332 28207 leader_election.cc:302] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0184701273547ce9356b651d84dad45, f9d7bd5e0ad94e8095d2eecb39f3f489; no voters:
I20260812 11:21:32.166370 28056 raft_consensus.cc:2454] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 0.
I20260812 11:21:32.166597 28532 raft_consensus.cc:2781] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:32.166659 28532 raft_consensus.cc:482] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:32.166694 28532 raft_consensus.cc:3037] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.167917 28532 raft_consensus.cc:504] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.168268 28532 leader_election.cc:288] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 election: Requested vote from peers f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193), 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985)
I20260812 11:21:32.168555 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18294a3644fc4fb8a9c306428aa6b086" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
I20260812 11:21:32.168660 27773 raft_consensus.cc:3037] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.168675 28056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18294a3644fc4fb8a9c306428aa6b086" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682de1daa12f454e8d774279b4782960"
I20260812 11:21:32.168766 28056 raft_consensus.cc:3037] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.169776 28056 raft_consensus.cc:2454] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 1.
I20260812 11:21:32.169776 27773 raft_consensus.cc:2454] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 1.
I20260812 11:21:32.170074 28208 leader_election.cc:302] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, a0184701273547ce9356b651d84dad45; no voters:
I20260812 11:21:32.170231 28532 raft_consensus.cc:2781] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:32.170410 28532 raft_consensus.cc:686] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 1 LEADER]: Becoming Leader. State: Replica: a0184701273547ce9356b651d84dad45, State: Running, Role: LEADER
I20260812 11:21:32.170635 28532 consensus_queue.cc:237] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.172840 27448 catalog_manager.cc:5495] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0184701273547ce9356b651d84dad45 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } health_report { overall_health: HEALTHY } } }
Aug 12 11:21:32 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533690, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.254@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:32.217798 28614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.208995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55750 (local address 127.12.175.254:46161)
0812 11:21:32.209294 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.209310 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.209328 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:21:32.209431 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.209434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.209488 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.209598 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:32.210333 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.211179 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.212028 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.212238 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.212325 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.214740 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:32.214743 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:32.214745 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:32.214766 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:32.216167 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:32.216599 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:32.216603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:32.216604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:32.216681 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:32.216916 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:32.216920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:32.216921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:32.217127 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:32.217218 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.217497 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.217649 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":228,"thread_start_us":122,"threads_started":1}
I20260812 11:21:32.217798 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.208910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:46161 (local address 127.0.0.1:55750)
0812 11:21:32.209227 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.209241 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.209337 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.209620 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.209623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.210112 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:32.210212 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.210218 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.211317 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.211320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.211882 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.211890 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.212337 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.212340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.212430 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.212951 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:32.212963 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:32.214606 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:32.216266 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:32.216276 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:32.216283 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:32.216504 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:32.216760 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:32.216763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:32.216765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:32.216838 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:32.217217 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:32.217223 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:32.217340 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.217436 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.217598 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":2,"thread_start_us":113,"threads_started":1}
I20260812 11:21:32.221943 27448 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:55750:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:21:32.222676 27448 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:32.227582 27730 tablet_service.cc:1467] Processing CreateTablet for tablet 6867c53b5c8545278fa93b78ea9a4d72 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c36e37b4e6e6462ea92ac88ae8928435]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:32.227964 27730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6867c53b5c8545278fa93b78ea9a4d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.227833 28309 tablet_service.cc:1467] Processing CreateTablet for tablet 6867c53b5c8545278fa93b78ea9a4d72 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c36e37b4e6e6462ea92ac88ae8928435]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:32.228222 28309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6867c53b5c8545278fa93b78ea9a4d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.230374 28522 tablet_bootstrap.cc:492] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: Bootstrap starting.
I20260812 11:21:32.230691 28025 tablet_service.cc:1467] Processing CreateTablet for tablet 6867c53b5c8545278fa93b78ea9a4d72 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c36e37b4e6e6462ea92ac88ae8928435]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:21:32.231045 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6867c53b5c8545278fa93b78ea9a4d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.231468 28521 tablet_bootstrap.cc:492] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: Bootstrap starting.
I20260812 11:21:32.231482 28522 tablet_bootstrap.cc:654] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.232345 28521 tablet_bootstrap.cc:654] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.233466 28528 tablet_bootstrap.cc:492] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: Bootstrap starting.
I20260812 11:21:32.233520 28521 tablet_bootstrap.cc:492] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: No bootstrap required, opened a new log
I20260812 11:21:32.233589 28521 ts_tablet_manager.cc:1397] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:32.233994 28521 raft_consensus.cc:348] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.234125 28521 raft_consensus.cc:374] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.234154 28521 raft_consensus.cc:729] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0184701273547ce9356b651d84dad45, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.234265 28528 tablet_bootstrap.cc:654] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.234270 28521 consensus_queue.cc:260] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.234504 28521 ts_tablet_manager.cc:1428] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.234500 28532 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.234685 28532 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.235539 28522 tablet_bootstrap.cc:492] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: No bootstrap required, opened a new log
I20260812 11:21:32.235633 28522 ts_tablet_manager.cc:1397] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 11:21:32.236075 28522 raft_consensus.cc:348] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.236174 28522 raft_consensus.cc:374] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.236194 28522 raft_consensus.cc:729] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d7bd5e0ad94e8095d2eecb39f3f489, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.236310 28522 consensus_queue.cc:260] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.236532 28522 ts_tablet_manager.cc:1428] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.236549 28536 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.236701 28536 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.237664 28528 tablet_bootstrap.cc:492] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: No bootstrap required, opened a new log
I20260812 11:21:32.237747 28528 ts_tablet_manager.cc:1397] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 11:21:32.238102 28528 raft_consensus.cc:348] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.238190 28528 raft_consensus.cc:374] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.238219 28528 raft_consensus.cc:729] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682de1daa12f454e8d774279b4782960, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.238336 28528 consensus_queue.cc:260] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.238579 28528 ts_tablet_manager.cc:1428] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:21:32.238585 28576 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.238741 28576 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.452049 28532 raft_consensus.cc:482] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:32.452209 28532 raft_consensus.cc:504] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.452700 28532 leader_election.cc:288] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193), 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985)
I20260812 11:21:32.453198 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6867c53b5c8545278fa93b78ea9a4d72" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" is_pre_election: true
I20260812 11:21:32.453240 28056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6867c53b5c8545278fa93b78ea9a4d72" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682de1daa12f454e8d774279b4782960" is_pre_election: true
I20260812 11:21:32.453368 27773 raft_consensus.cc:2454] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 0.
I20260812 11:21:32.453423 28056 raft_consensus.cc:2454] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 0.
I20260812 11:21:32.453744 28208 leader_election.cc:302] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, a0184701273547ce9356b651d84dad45; no voters:
I20260812 11:21:32.453953 28532 raft_consensus.cc:2781] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:32.454015 28532 raft_consensus.cc:482] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:32.454061 28532 raft_consensus.cc:3037] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.455178 28532 raft_consensus.cc:504] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.455520 28532 leader_election.cc:288] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 election: Requested vote from peers f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193), 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985)
I20260812 11:21:32.455871 28056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6867c53b5c8545278fa93b78ea9a4d72" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682de1daa12f454e8d774279b4782960"
I20260812 11:21:32.455893 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6867c53b5c8545278fa93b78ea9a4d72" candidate_uuid: "a0184701273547ce9356b651d84dad45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
I20260812 11:21:32.455969 28056 raft_consensus.cc:3037] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.456005 27773 raft_consensus.cc:3037] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.456804 28056 raft_consensus.cc:2454] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 1.
I20260812 11:21:32.457072 27773 raft_consensus.cc:2454] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0184701273547ce9356b651d84dad45 in term 1.
I20260812 11:21:32.457103 28208 leader_election.cc:302] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, a0184701273547ce9356b651d84dad45; no voters:
I20260812 11:21:32.467330 28532 raft_consensus.cc:2781] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:32.467425 28532 raft_consensus.cc:686] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [term 1 LEADER]: Becoming Leader. State: Replica: a0184701273547ce9356b651d84dad45, State: Running, Role: LEADER
I20260812 11:21:32.467561 28532 consensus_queue.cc:237] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.468189 28598 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: TxnStatusTablet state changed. Reason: New leader a0184701273547ce9356b651d84dad45. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.468300 28598 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:32.469182 28627 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:21:32.469369 28627 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:21:32.469465 27450 catalog_manager.cc:5495] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0184701273547ce9356b651d84dad45 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } health_report { overall_health: HEALTHY } } }
I20260812 11:21:32.529625 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.526059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37476 (local address 127.12.175.195:34591)
0812 11:21:32.526190 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.526195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.526209 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:32.526398 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.526401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.526458 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.526538 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.526777 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.527324 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.528163 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.528424 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.528514 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.528804 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.529224 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.529327 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.529411 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.529466 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:32.529605 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.525928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34591 (local address 127.0.0.1:37476)
0812 11:21:32.526143 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.526158 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.526262 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.526567 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.526570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.526578 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:32.526683 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.526688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.527437 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.527441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.528053 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.528061 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.528524 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.528534 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.528628 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.528672 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.529321 (+ 649us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.529337 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.529399 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.529483 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260812 11:21:32.532495 27773 raft_consensus.cc:1261] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Refusing update from remote peer a0184701273547ce9356b651d84dad45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.532665 28056 raft_consensus.cc:1261] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Refusing update from remote peer a0184701273547ce9356b651d84dad45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.533262 28532 consensus_queue.cc:1035] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.533742 28532 consensus_queue.cc:1035] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.535071 28536 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: TxnStatusTablet state changed. Reason: New leader a0184701273547ce9356b651d84dad45. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.535108 28576 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: TxnStatusTablet state changed. Reason: New leader a0184701273547ce9356b651d84dad45. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.535189 28536 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.535215 28576 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.538547 28532 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.538638 28636 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.538745 28636 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:32.539286 28536 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.539386 28536 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P f9d7bd5e0ad94e8095d2eecb39f3f489: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.538652 28532 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P a0184701273547ce9356b651d84dad45: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:21:32.542109 28560 mvcc.cc:205] Tried to move back new op lower bound from 7317642004607623168 to 7317642004348370944. Current Snapshot: MvccSnapshot[applied={T|T < 7317642004607623168}]
I20260812 11:21:32.542275 28576 tablet_replica.cc:439] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0184701273547ce9356b651d84dad45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } } }
I20260812 11:21:32.542366 28576 tablet_replica.cc:442] T 6867c53b5c8545278fa93b78ea9a4d72 P 682de1daa12f454e8d774279b4782960: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:21:32.546438 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.543310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37484 (local address 127.12.175.195:34591)
0812 11:21:32.543399 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.543403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.543612 (+ 209us) server_negotiation.cc:407] Connection header received
0812 11:21:32.543656 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.543660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.543711 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.543771 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.544118 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.544644 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.545477 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.545716 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.545799 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.546039 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.546105 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.546160 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.546261 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.546308 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:21:32.555588 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.552634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40545 (local address 127.12.175.195:34591)
0812 11:21:32.552734 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.552738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.552924 (+ 186us) server_negotiation.cc:407] Connection header received
0812 11:21:32.553019 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.553022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.553060 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.553118 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.553342 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.553799 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.554632 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.554845 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.554925 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.555193 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.555258 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.555340 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.555417 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.555454 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:21:32.555908 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.552571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34591 (local address 127.12.175.195:40545)
0812 11:21:32.552855 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.552865 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.552952 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.553125 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.553127 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.553133 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:32.553261 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.553268 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.553895 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.553899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.554531 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.554540 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.554956 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.554960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.555047 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.555083 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.555342 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.555347 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.555399 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.555470 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":76,"threads_started":1}
I20260812 11:21:32.562886 28056 raft_consensus.cc:1261] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Refusing update from remote peer a0184701273547ce9356b651d84dad45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.563026 27773 raft_consensus.cc:1261] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Refusing update from remote peer a0184701273547ce9356b651d84dad45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.563282 28532 consensus_queue.cc:1035] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.563740 28532 consensus_queue.cc:1035] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.612262 27448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:32.612422 27448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:32.614425 27448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Sending DeleteTablet for 3 replicas of tablet 18294a3644fc4fb8a9c306428aa6b086
I20260812 11:21:32.614969 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet 18294a3644fc4fb8a9c306428aa6b086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:37468
I20260812 11:21:32.614985 27730 tablet_service.cc:1514] Processing DeleteTablet for tablet 18294a3644fc4fb8a9c306428aa6b086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:39838
I20260812 11:21:32.615482 28025 tablet_service.cc:1514] Processing DeleteTablet for tablet 18294a3644fc4fb8a9c306428aa6b086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:33122
I20260812 11:21:32.615775 28662 tablet_replica.cc:330] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: stopping tablet replica
I20260812 11:21:32.615792 28658 tablet_replica.cc:330] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: stopping tablet replica
I20260812 11:21:32.615903 28658 raft_consensus.cc:2229] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:32.616024 28662 raft_consensus.cc:2229] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:32.616173 28658 raft_consensus.cc:2258] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.616276 28662 raft_consensus.cc:2258] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.616770 28658 ts_tablet_manager.cc:1905] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.617070 28662 ts_tablet_manager.cc:1905] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.619835 28658 ts_tablet_manager.cc:1918] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:32.619922 28658 log.cc:1196] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/18294a3644fc4fb8a9c306428aa6b086
I20260812 11:21:32.620190 28658 ts_tablet_manager.cc:1939] T 18294a3644fc4fb8a9c306428aa6b086 P a0184701273547ce9356b651d84dad45: Deleting consensus metadata
I20260812 11:21:32.620373 28662 ts_tablet_manager.cc:1918] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:32.620512 28662 log.cc:1196] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/18294a3644fc4fb8a9c306428aa6b086
I20260812 11:21:32.620792 27423 catalog_manager.cc:4841] TS a0184701273547ce9356b651d84dad45 (127.12.175.195:34591): tablet 18294a3644fc4fb8a9c306428aa6b086 (table test-table [id=b744c720af644e2ab480483b8b1c712c]) successfully deleted
I20260812 11:21:32.620870 28659 tablet_replica.cc:330] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: stopping tablet replica
I20260812 11:21:32.620980 28659 raft_consensus.cc:2229] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:32.621100 28659 raft_consensus.cc:2258] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.621266 28662 ts_tablet_manager.cc:1939] T 18294a3644fc4fb8a9c306428aa6b086 P 682de1daa12f454e8d774279b4782960: Deleting consensus metadata
I20260812 11:21:32.621740 28659 ts_tablet_manager.cc:1905] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.621963 27424 catalog_manager.cc:4841] TS 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985): tablet 18294a3644fc4fb8a9c306428aa6b086 (table test-table [id=b744c720af644e2ab480483b8b1c712c]) successfully deleted
I20260812 11:21:32.624454 28659 ts_tablet_manager.cc:1918] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:32.624533 28659 log.cc:1196] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/18294a3644fc4fb8a9c306428aa6b086
I20260812 11:21:32.624766 28659 ts_tablet_manager.cc:1939] T 18294a3644fc4fb8a9c306428aa6b086 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting consensus metadata
I20260812 11:21:32.625399 27423 catalog_manager.cc:4841] TS f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193): tablet 18294a3644fc4fb8a9c306428aa6b086 (table test-table [id=b744c720af644e2ab480483b8b1c712c]) successfully deleted
Aug 12 11:21:32 dist-test-slave-gjrz krb5kdc[27360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:21:32 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:32 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:21:32.646096 28614 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:32.640111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55756 (local address 127.12.175.254:46161)
0812 11:21:32.640243 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.640248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.640467 (+ 219us) server_negotiation.cc:407] Connection header received
0812 11:21:32.640597 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.640600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.640645 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.640706 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:32.641385 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.641933 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.642743 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.642980 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.643067 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.645967 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55756: BlockingRecv error: recv got EOF from 127.0.0.1:55756 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 11:21:32 dist-test-slave-gjrz krb5kdc[27360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM
I20260812 11:21:32.655208 28614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.647388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55762 (local address 127.12.175.254:46161)
0812 11:21:32.647483 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.647486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.647520 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:21:32.647640 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.647642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.647674 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.647731 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:32.648350 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.648814 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.649856 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.650051 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.650112 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.652479 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:32.652482 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:32.652484 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:32.652506 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:32.653756 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:32.654124 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:32.654127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:32.654129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:32.654202 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:32.654447 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:32.654451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:32.654452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:32.654619 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:32.654736 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.654956 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.655076 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:21:32.657474 27448 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:32.657903 27448 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:32.662842 27730 tablet_service.cc:1467] Processing CreateTablet for tablet 8e26a243971e422f876595518eeaed87 (DEFAULT_TABLE table=test-table [id=6425cc6391f8455ebcad97808b5f6723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.662904 28306 tablet_service.cc:1467] Processing CreateTablet for tablet 8e26a243971e422f876595518eeaed87 (DEFAULT_TABLE table=test-table [id=6425cc6391f8455ebcad97808b5f6723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.663161 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e26a243971e422f876595518eeaed87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.663163 27730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e26a243971e422f876595518eeaed87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.665704 28522 tablet_bootstrap.cc:492] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Bootstrap starting.
I20260812 11:21:32.665704 28521 tablet_bootstrap.cc:492] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Bootstrap starting.
I20260812 11:21:32.666507 28521 tablet_bootstrap.cc:654] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.666523 28522 tablet_bootstrap.cc:654] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.667896 28521 tablet_bootstrap.cc:492] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: No bootstrap required, opened a new log
I20260812 11:21:32.667979 28521 ts_tablet_manager.cc:1397] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:32.667994 28025 tablet_service.cc:1467] Processing CreateTablet for tablet 8e26a243971e422f876595518eeaed87 (DEFAULT_TABLE table=test-table [id=6425cc6391f8455ebcad97808b5f6723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.668265 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e26a243971e422f876595518eeaed87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.668362 28521 raft_consensus.cc:348] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.668463 28521 raft_consensus.cc:374] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.668493 28522 tablet_bootstrap.cc:492] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: No bootstrap required, opened a new log
I20260812 11:21:32.668494 28521 raft_consensus.cc:729] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0184701273547ce9356b651d84dad45, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.668565 28522 ts_tablet_manager.cc:1397] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 11:21:32.668624 28521 consensus_queue.cc:260] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.668874 28521 ts_tablet_manager.cc:1428] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.668942 28522 raft_consensus.cc:348] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.669051 28522 raft_consensus.cc:374] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.669085 28522 raft_consensus.cc:729] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d7bd5e0ad94e8095d2eecb39f3f489, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.669196 28522 consensus_queue.cc:260] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.669456 28522 ts_tablet_manager.cc:1428] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.670428 28528 tablet_bootstrap.cc:492] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Bootstrap starting.
I20260812 11:21:32.671221 28528 tablet_bootstrap.cc:654] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.673041 28528 tablet_bootstrap.cc:492] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: No bootstrap required, opened a new log
I20260812 11:21:32.673130 28528 ts_tablet_manager.cc:1397] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 11:21:32.673509 28528 raft_consensus.cc:348] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.673615 28528 raft_consensus.cc:374] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.673651 28528 raft_consensus.cc:729] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682de1daa12f454e8d774279b4782960, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.673771 28528 consensus_queue.cc:260] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.674037 28528 ts_tablet_manager.cc:1428] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.699899 28536 raft_consensus.cc:482] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:32.699987 28536 raft_consensus.cc:504] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.701120 28536 leader_election.cc:288] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985), a0184701273547ce9356b651d84dad45 (127.12.175.195:34591)
I20260812 11:21:32.705027 28686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.701224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41985 (local address 127.12.175.193:33185)
0812 11:21:32.701537 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.701552 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.701644 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.702063 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.702067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.702086 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:32.702200 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.702206 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.703131 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.703134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.703984 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.703994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.704620 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.704623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.704731 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.704755 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.704822 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.704890 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":58,"threads_started":1}
I20260812 11:21:32.705468 28691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.701349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:33185 (local address 127.12.175.194:41985)
0812 11:21:32.701817 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.701820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.701830 (+ 10us) server_negotiation.cc:407] Connection header received
0812 11:21:32.701867 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.701869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.701920 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.702032 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:32.702311 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.703025 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.704102 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.704513 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.704620 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.704673 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.705265 (+ 592us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.705350 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":75,"threads_started":1}
I20260812 11:21:32.705862 28056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26a243971e422f876595518eeaed87" candidate_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682de1daa12f454e8d774279b4782960" is_pre_election: true
I20260812 11:21:32.705950 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.701609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:35873 (local address 127.12.175.195:34591)
0812 11:21:32.701708 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.701713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.701726 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:32.701770 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.701773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.701811 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.701900 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:32.702175 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.702922 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.704745 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.705323 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.705434 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.705482 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.705778 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.705849 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:21:32.705994 28056 raft_consensus.cc:2454] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d7bd5e0ad94e8095d2eecb39f3f489 in term 0.
I20260812 11:21:32.705981 28685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.701325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34591 (local address 127.12.175.193:35873)
0812 11:21:32.701599 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.701610 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.701669 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.701918 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.701922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.701939 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:32.702077 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.702086 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.703047 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.703051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.704629 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.704640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.705460 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.705465 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.705647 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.705671 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.705747 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.705811 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":59,"threads_started":1}
I20260812 11:21:32.706360 27648 leader_election.cc:302] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, f9d7bd5e0ad94e8095d2eecb39f3f489; no voters:
I20260812 11:21:32.706585 28536 raft_consensus.cc:2781] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:32.706650 28536 raft_consensus.cc:482] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:32.706687 28536 raft_consensus.cc:3037] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.706761 28359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26a243971e422f876595518eeaed87" candidate_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0184701273547ce9356b651d84dad45" is_pre_election: true
I20260812 11:21:32.706878 28359 raft_consensus.cc:2454] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d7bd5e0ad94e8095d2eecb39f3f489 in term 0.
I20260812 11:21:32.707813 28536 raft_consensus.cc:504] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.708150 28536 leader_election.cc:288] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [CANDIDATE]: Term 1 election: Requested vote from peers 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985), a0184701273547ce9356b651d84dad45 (127.12.175.195:34591)
I20260812 11:21:32.708432 28056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26a243971e422f876595518eeaed87" candidate_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682de1daa12f454e8d774279b4782960"
I20260812 11:21:32.708437 28359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26a243971e422f876595518eeaed87" candidate_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0184701273547ce9356b651d84dad45"
I20260812 11:21:32.708541 28056 raft_consensus.cc:3037] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.708549 28359 raft_consensus.cc:3037] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.709517 28056 raft_consensus.cc:2454] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d7bd5e0ad94e8095d2eecb39f3f489 in term 1.
I20260812 11:21:32.709517 28359 raft_consensus.cc:2454] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d7bd5e0ad94e8095d2eecb39f3f489 in term 1.
I20260812 11:21:32.709790 27648 leader_election.cc:302] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, f9d7bd5e0ad94e8095d2eecb39f3f489; no voters:
I20260812 11:21:32.709985 28536 raft_consensus.cc:2781] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:32.710167 28536 raft_consensus.cc:686] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 LEADER]: Becoming Leader. State: Replica: f9d7bd5e0ad94e8095d2eecb39f3f489, State: Running, Role: LEADER
I20260812 11:21:32.710393 28536 consensus_queue.cc:237] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.712385 27450 catalog_manager.cc:5495] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:32.726380 28699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.723063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39844 (local address 127.12.175.193:46193)
0812 11:21:32.723324 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.723333 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.723345 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:32.723398 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.723400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.723442 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.723539 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.723765 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.724264 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.725066 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.725281 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.725364 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.725622 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.726019 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.726129 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.726197 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.726244 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":91,"threads_started":1}
I20260812 11:21:32.728653 28359 raft_consensus.cc:1261] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Refusing update from remote peer f9d7bd5e0ad94e8095d2eecb39f3f489: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.728761 28056 raft_consensus.cc:1261] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Refusing update from remote peer f9d7bd5e0ad94e8095d2eecb39f3f489: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.729106 28693 consensus_queue.cc:1035] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.729441 28693 consensus_queue.cc:1035] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.739693 27448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:32.739820 27448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:32.741753 27448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Sending DeleteTablet for 3 replicas of tablet 8e26a243971e422f876595518eeaed87
I20260812 11:21:32.742298 27730 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e26a243971e422f876595518eeaed87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:39838
I20260812 11:21:32.742291 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e26a243971e422f876595518eeaed87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:37468
I20260812 11:21:32.742442 28658 tablet_replica.cc:330] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: stopping tablet replica
I20260812 11:21:32.742442 28659 tablet_replica.cc:330] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: stopping tablet replica
I20260812 11:21:32.742496 28025 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e26a243971e422f876595518eeaed87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:32 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:33122
I20260812 11:21:32.742539 28658 raft_consensus.cc:2229] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:32.742549 28659 raft_consensus.cc:2229] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:32.742638 28662 tablet_replica.cc:330] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: stopping tablet replica
I20260812 11:21:32.742648 28658 raft_consensus.cc:2258] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.742734 28662 raft_consensus.cc:2229] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:32.742789 28659 raft_consensus.cc:2258] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.742848 28662 raft_consensus.cc:2258] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:32.743516 28658 ts_tablet_manager.cc:1905] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.743516 28659 ts_tablet_manager.cc:1905] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.743561 27448 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:32.743920 27448 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:32.745811 28658 ts_tablet_manager.cc:1918] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:32.745811 28659 ts_tablet_manager.cc:1918] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:32.745877 28658 log.cc:1196] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/8e26a243971e422f876595518eeaed87
I20260812 11:21:32.745901 28659 log.cc:1196] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/8e26a243971e422f876595518eeaed87
I20260812 11:21:32.746121 28658 ts_tablet_manager.cc:1939] T 8e26a243971e422f876595518eeaed87 P a0184701273547ce9356b651d84dad45: Deleting consensus metadata
I20260812 11:21:32.746121 28659 ts_tablet_manager.cc:1939] T 8e26a243971e422f876595518eeaed87 P f9d7bd5e0ad94e8095d2eecb39f3f489: Deleting consensus metadata
I20260812 11:21:32.746928 27423 catalog_manager.cc:4841] TS a0184701273547ce9356b651d84dad45 (127.12.175.195:34591): tablet 8e26a243971e422f876595518eeaed87 (table test-table [id=6425cc6391f8455ebcad97808b5f6723]) successfully deleted
I20260812 11:21:32.747079 27423 catalog_manager.cc:4841] TS f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193): tablet 8e26a243971e422f876595518eeaed87 (table test-table [id=6425cc6391f8455ebcad97808b5f6723]) successfully deleted
I20260812 11:21:32.747893 28662 ts_tablet_manager.cc:1905] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:32.750276 28662 ts_tablet_manager.cc:1918] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:32.750357 28662 log.cc:1196] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/8e26a243971e422f876595518eeaed87
I20260812 11:21:32.750617 28662 ts_tablet_manager.cc:1939] T 8e26a243971e422f876595518eeaed87 P 682de1daa12f454e8d774279b4782960: Deleting consensus metadata
I20260812 11:21:32.751237 27424 catalog_manager.cc:4841] TS 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985): tablet 8e26a243971e422f876595518eeaed87 (table test-table [id=6425cc6391f8455ebcad97808b5f6723]) successfully deleted
I20260812 11:21:32.753616 27730 tablet_service.cc:1467] Processing CreateTablet for tablet 51a8e98e162d424ca508fcc7900c1464 (DEFAULT_TABLE table=test-table [id=66cc04c192584669bc7f8f90bab31a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.753849 27730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a8e98e162d424ca508fcc7900c1464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.754050 28025 tablet_service.cc:1467] Processing CreateTablet for tablet 51a8e98e162d424ca508fcc7900c1464 (DEFAULT_TABLE table=test-table [id=66cc04c192584669bc7f8f90bab31a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.754263 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a8e98e162d424ca508fcc7900c1464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.755967 28522 tablet_bootstrap.cc:492] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489: Bootstrap starting.
I20260812 11:21:32.756825 28522 tablet_bootstrap.cc:654] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.757397 28528 tablet_bootstrap.cc:492] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Bootstrap starting.
I20260812 11:21:32.758134 28528 tablet_bootstrap.cc:654] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.759164 28306 tablet_service.cc:1467] Processing CreateTablet for tablet 51a8e98e162d424ca508fcc7900c1464 (DEFAULT_TABLE table=test-table [id=66cc04c192584669bc7f8f90bab31a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:32.759459 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a8e98e162d424ca508fcc7900c1464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:32.761624 28521 tablet_bootstrap.cc:492] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Bootstrap starting.
I20260812 11:21:32.762275 28528 tablet_bootstrap.cc:492] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: No bootstrap required, opened a new log
I20260812 11:21:32.762346 28528 ts_tablet_manager.cc:1397] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 11:21:32.762620 28521 tablet_bootstrap.cc:654] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:32.762727 28528 raft_consensus.cc:348] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.762825 28528 raft_consensus.cc:374] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.762853 28528 raft_consensus.cc:729] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682de1daa12f454e8d774279b4782960, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.762959 28528 consensus_queue.cc:260] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.763192 28528 ts_tablet_manager.cc:1428] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.763700 28522 tablet_bootstrap.cc:492] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489: No bootstrap required, opened a new log
I20260812 11:21:32.763777 28522 ts_tablet_manager.cc:1397] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260812 11:21:32.764146 28522 raft_consensus.cc:348] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.764256 28522 raft_consensus.cc:374] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.764284 28522 raft_consensus.cc:729] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d7bd5e0ad94e8095d2eecb39f3f489, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.764392 28522 consensus_queue.cc:260] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.764644 28522 ts_tablet_manager.cc:1428] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.768790 28521 tablet_bootstrap.cc:492] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: No bootstrap required, opened a new log
I20260812 11:21:32.768877 28521 ts_tablet_manager.cc:1397] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 11:21:32.769266 28521 raft_consensus.cc:348] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.769368 28521 raft_consensus.cc:374] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:32.769402 28521 raft_consensus.cc:729] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0184701273547ce9356b651d84dad45, State: Initialized, Role: FOLLOWER
I20260812 11:21:32.769517 28521 consensus_queue.cc:260] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.769779 28521 ts_tablet_manager.cc:1428] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:21:32.825057 28576 raft_consensus.cc:482] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:32.825248 28576 raft_consensus.cc:504] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.825662 28576 leader_election.cc:288] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193), a0184701273547ce9356b651d84dad45 (127.12.175.195:34591)
I20260812 11:21:32.826046 27772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a8e98e162d424ca508fcc7900c1464" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" is_pre_election: true
I20260812 11:21:32.826144 28359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a8e98e162d424ca508fcc7900c1464" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0184701273547ce9356b651d84dad45" is_pre_election: true
I20260812 11:21:32.826200 27772 raft_consensus.cc:2454] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 0.
I20260812 11:21:32.826279 28359 raft_consensus.cc:2454] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 0.
I20260812 11:21:32.826489 27918 leader_election.cc:302] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, f9d7bd5e0ad94e8095d2eecb39f3f489; no voters:
I20260812 11:21:32.826694 28576 raft_consensus.cc:2781] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:32.826756 28576 raft_consensus.cc:482] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:32.826797 28576 raft_consensus.cc:3037] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.827769 28576 raft_consensus.cc:504] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.828061 28576 leader_election.cc:288] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 election: Requested vote from peers f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193), a0184701273547ce9356b651d84dad45 (127.12.175.195:34591)
I20260812 11:21:32.828428 27772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a8e98e162d424ca508fcc7900c1464" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489"
I20260812 11:21:32.828420 28359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a8e98e162d424ca508fcc7900c1464" candidate_uuid: "682de1daa12f454e8d774279b4782960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0184701273547ce9356b651d84dad45"
I20260812 11:21:32.828533 27772 raft_consensus.cc:3037] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.828534 28359 raft_consensus.cc:3037] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:32.829577 27772 raft_consensus.cc:2454] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 1.
I20260812 11:21:32.829578 28359 raft_consensus.cc:2454] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682de1daa12f454e8d774279b4782960 in term 1.
I20260812 11:21:32.829839 27918 leader_election.cc:302] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682de1daa12f454e8d774279b4782960, f9d7bd5e0ad94e8095d2eecb39f3f489; no voters:
I20260812 11:21:32.830001 28576 raft_consensus.cc:2781] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:32.830191 28576 raft_consensus.cc:686] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 1 LEADER]: Becoming Leader. State: Replica: 682de1daa12f454e8d774279b4782960, State: Running, Role: LEADER
I20260812 11:21:32.830338 28576 consensus_queue.cc:237] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } }
I20260812 11:21:32.834020 27448 catalog_manager.cc:5495] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682de1daa12f454e8d774279b4782960 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "682de1daa12f454e8d774279b4782960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682de1daa12f454e8d774279b4782960" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:32.886390 28691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.878999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33134 (local address 127.12.175.194:41985)
0812 11:21:32.879253 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.879302 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.879331 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:21:32.879409 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.879411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.879451 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.879507 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.879990 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.881017 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.883873 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.884310 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.884468 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.885279 (+ 811us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.885419 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.885544 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.885868 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.885945 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 11:21:32.909689 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.900436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:34591 (local address 127.12.175.194:40451)
0812 11:21:32.900956 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.900969 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.901050 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.901438 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.901445 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.901465 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:32.901644 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.901654 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.903770 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.903786 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.905304 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.905362 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.907361 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.907384 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.907666 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.907775 (+ 109us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.908694 (+ 919us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.908712 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.908887 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.909074 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":166,"threads_started":1}
I20260812 11:21:32.909708 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.900629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:40451 (local address 127.12.175.195:34591)
0812 11:21:32.900941 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.900945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.901031 (+ 86us) server_negotiation.cc:407] Connection header received
0812 11:21:32.901133 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.901136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.901189 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.901432 (+ 243us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.901845 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.903626 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.905771 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.906812 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.907384 (+ 572us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.908187 (+ 803us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.908486 (+ 299us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.908681 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.908964 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.909187 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260812 11:21:32.928735 27773 raft_consensus.cc:1261] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Refusing update from remote peer 682de1daa12f454e8d774279b4782960: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.928735 28359 raft_consensus.cc:1261] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Refusing update from remote peer 682de1daa12f454e8d774279b4782960: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:32.930168 28714 consensus_queue.cc:1035] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d7bd5e0ad94e8095d2eecb39f3f489" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.930802 28576 consensus_queue.cc:1035] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0184701273547ce9356b651d84dad45" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 34591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:32.984179 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.977318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41985 (local address 127.12.175.195:35195)
0812 11:21:32.977826 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:32.977850 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:32.978029 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:32.978630 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:32.978641 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:32.978650 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:21:32.978800 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.978808 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.980178 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.980182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.981509 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:32.981521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.982903 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.982913 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:32.983078 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.983123 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.983730 (+ 607us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.983737 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:21:32.983845 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 11:21:32.983974 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344}
I20260812 11:21:32.985049 28691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:32.977679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:35195 (local address 127.12.175.194:41985)
0812 11:21:32.978198 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:32.978209 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:32.978223 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:32.978283 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:32.978286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:32.978363 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:32.978461 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:32.978943 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.980000 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.981704 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:32.982205 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:32.982361 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:32.983385 (+ 1024us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:32.983520 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:32.983637 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:32.984745 (+ 1108us) server_negotiation.cc:299] Negotiation successful
0812 11:21:32.984827 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419}
I20260812 11:21:33.033814 27448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:33.034380 27448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:33.041574 27448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f9445522d1f543dc8caa2c2672c3d218: Sending DeleteTablet for 3 replicas of tablet 51a8e98e162d424ca508fcc7900c1464
I20260812 11:21:33.042861 27730 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a8e98e162d424ca508fcc7900c1464 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:33 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:39838
I20260812 11:21:33.043087 28025 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a8e98e162d424ca508fcc7900c1464 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:33 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:33122
I20260812 11:21:33.043521 28659 tablet_replica.cc:330] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489: stopping tablet replica
I20260812 11:21:33.043797 28662 tablet_replica.cc:330] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: stopping tablet replica
I20260812 11:21:33.043990 28659 raft_consensus.cc:2229] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:33.044330 28662 raft_consensus.cc:2229] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:33.044410 28659 raft_consensus.cc:2258] T 51a8e98e162d424ca508fcc7900c1464 P f9d7bd5e0ad94e8095d2eecb39f3f489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:33.044766 28662 raft_consensus.cc:2258] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:33.045749 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a8e98e162d424ca508fcc7900c1464 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:33 UTC) from {username='oryx', principal='oryx/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:37468
I20260812 11:21:33.046214 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 27605
I20260812 11:21:33.065229 28662 ts_tablet_manager.cc:1905] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:33.074240 28662 ts_tablet_manager.cc:1918] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:33.074576 28662 log.cc:1196] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/51a8e98e162d424ca508fcc7900c1464
I20260812 11:21:33.075870 28662 ts_tablet_manager.cc:1939] T 51a8e98e162d424ca508fcc7900c1464 P 682de1daa12f454e8d774279b4782960: Deleting consensus metadata
I20260812 11:21:33.076683 28658 tablet_replica.cc:330] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: stopping tablet replica
I20260812 11:21:33.077319 28658 raft_consensus.cc:2229] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:33.077911 28658 raft_consensus.cc:2258] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:33.078562 27424 catalog_manager.cc:4841] TS 682de1daa12f454e8d774279b4782960 (127.12.175.194:41985): tablet 51a8e98e162d424ca508fcc7900c1464 (table test-table [id=66cc04c192584669bc7f8f90bab31a98]) successfully deleted
I20260812 11:21:33.079969 28658 ts_tablet_manager.cc:1905] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:33.086452 28658 ts_tablet_manager.cc:1918] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:21:33.086716 28658 log.cc:1196] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/51a8e98e162d424ca508fcc7900c1464
I20260812 11:21:33.087509 28658 ts_tablet_manager.cc:1939] T 51a8e98e162d424ca508fcc7900c1464 P a0184701273547ce9356b651d84dad45: Deleting consensus metadata
I20260812 11:21:33.089248 27423 catalog_manager.cc:4841] TS a0184701273547ce9356b651d84dad45 (127.12.175.195:34591): tablet 51a8e98e162d424ca508fcc7900c1464 (table test-table [id=66cc04c192584669bc7f8f90bab31a98]) successfully deleted
W20260812 11:21:33.096247 27423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:46193 (error 108)
I20260812 11:21:33.096832 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 27890
I20260812 11:21:33.120013 28745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:33.116576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:46193 (local address 127.0.0.1:39850)
0812 11:21:33.119436 (+ 2860us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:33.119661 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:46193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2387,"thread_start_us":2055,"threads_started":1}
W20260812 11:21:33.120460 27423 catalog_manager.cc:4584] TS f9d7bd5e0ad94e8095d2eecb39f3f489 (127.12.175.193:46193): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 51a8e98e162d424ca508fcc7900c1464: Network error: Client connection negotiation failed: client connection to 127.12.175.193:46193: connect: Connection refused (error 111)
I20260812 11:21:33.136807 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 28166
I20260812 11:21:33.174803 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 27388
I20260812 11:21:33.175511 28745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:33.174420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:46193 (local address 127.0.0.1:39854)
0812 11:21:33.174889 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:33.175123 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:46193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
2026-08-12T11:21:33Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3713 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:33 dist-test-slave-gjrz krb5kdc[28753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:33 dist-test-slave-gjrz krb5kdc[28753](info): set up 2 sockets
Aug 12 11:21:33 dist-test-slave-gjrz krb5kdc[28753](info): commencing operation
krb5kdc: starting...
W20260812 11:21:34.753386 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.526s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:34 dist-test-slave-gjrz krb5kdc[28753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:34.867090 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38435
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:36329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:34.972031 28782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:34.972242 28782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:34.972278 28782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:34.976073 28782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:34.976118 28782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:34.976136 28782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:34.976150 28782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:34.976167 28782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:34.981045 28782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:36329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:34.981853 28782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:34.982715 28782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:34.990264 28789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:34.990269 28797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:34.990271 28801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:34.990482 28782 server_base.cc:1034] running on GCE node
I20260812 11:21:34.991142 28782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:34.992107 28782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:34.993248 28782 hybrid_clock.cc:648] HybridClock initialized: now 1786533694993228 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T11:21:35Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1808 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:35 dist-test-slave-gjrz krb5kdc[28810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:35 dist-test-slave-gjrz krb5kdc[28810](info): set up 2 sockets
Aug 12 11:21:35 dist-test-slave-gjrz krb5kdc[28810](info): commencing operation
krb5kdc: starting...
W20260812 11:21:36.198839 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:36.312000 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33361
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:33361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:36.423413 28832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:36.423728 28832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:36.423789 28832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:36.428478 28832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:36.428543 28832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:36.428568 28832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:36.428603 28832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:36.428625 28832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:36.435119 28832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:33361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:36.436162 28832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:36.437398 28832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:36.447770 28841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:36.447798 28844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:36.447930 28832 server_base.cc:1034] running on GCE node
W20260812 11:21:36.448187 28847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:36.448715 28832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:36.449767 28832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:36.450937 28832 hybrid_clock.cc:648] HybridClock initialized: now 1786533696450901 us; error 53 us; skew 500 ppm
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:36.453639 28832 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:36.454703 28832 webserver.cc:460] Webserver started at http://127.12.175.254:42887/ using document root <none> and password file <none>
I20260812 11:21:36.455231 28832 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:36.455330 28832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:36.455538 28832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:36.457612 28832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "26efde72621042a19a4bd3003fbd178d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "33b44e6c91c35c2d315336fcc89c5c86"
server_key_iv: "ff8d4e9e963a552aec1ae6467d982f93"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.458158 28832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "26efde72621042a19a4bd3003fbd178d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "33b44e6c91c35c2d315336fcc89c5c86"
server_key_iv: "ff8d4e9e963a552aec1ae6467d982f93"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.461637 28832 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 11:21:36.463846 28856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.464946 28832 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:21:36.465065 28832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "26efde72621042a19a4bd3003fbd178d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "33b44e6c91c35c2d315336fcc89c5c86"
server_key_iv: "ff8d4e9e963a552aec1ae6467d982f93"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.465154 28832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:36.478046 28832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:36.480779 28832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:36.480938 28832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:36.487447 28832 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:33361
I20260812 11:21:36.487460 28982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:33361 every 8 connection(s)
I20260812 11:21:36.488283 28832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:36.490819 28983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:36.495898 28983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Bootstrap starting.
I20260812 11:21:36.496994 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 28832
I20260812 11:21:36.497107 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:36.497352 12991 external_mini_cluster.cc:1428] Setting key 199e6446bbe976071b791cd6e2b676ac
I20260812 11:21:36.498312 28983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:36.498994 28983 log.cc:824] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:36.500931 28983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: No bootstrap required, opened a new log
I20260812 11:21:36.504840 28983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:36.505103 28983 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:36.505164 28983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26efde72621042a19a4bd3003fbd178d, State: Initialized, Role: FOLLOWER
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:36.505623 28983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:36.505775 28983 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:36.505842 28983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:36.505939 28983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:36.506737 28983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:36.507077 28983 leader_election.cc:302] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26efde72621042a19a4bd3003fbd178d; no voters:
I20260812 11:21:36.507413 28983 leader_election.cc:288] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:36.507491 28993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:36.507659 28993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 LEADER]: Becoming Leader. State: Replica: 26efde72621042a19a4bd3003fbd178d, State: Running, Role: LEADER
I20260812 11:21:36.507932 28993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:36.509624 28983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:36.509625 28996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26efde72621042a19a4bd3003fbd178d. Latest consensus state: current_term: 1 leader_uuid: "26efde72621042a19a4bd3003fbd178d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } } }
I20260812 11:21:36.509855 28996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:36.509672 28994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26efde72621042a19a4bd3003fbd178d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } } }
I20260812 11:21:36.510178 28994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:36.510317 28999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:36.511842 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:36.498311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33350 (local address 127.12.175.254:33361)
0812 11:21:36.498725 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:36.498739 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:36.498773 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:21:36.499430 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:36.499449 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:36.499747 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:36.500000 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:36.500843 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.501798 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.502982 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.503493 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.503609 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:36.506328 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:36.506333 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:36.506344 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:36.506369 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:36.508186 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:36.508686 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:36.508693 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:36.508700 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:36.508841 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:36.509314 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:36.509318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:36.509320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:36.509838 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:36.510606 (+ 768us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:36.510755 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:21:36.510969 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":125,"threads_started":1}
I20260812 11:21:36.514494 28999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:36.519776 28999 catalog_manager.cc:1347] Generated new cluster ID: 3b05d8b589ca4677aff1dcde2b6ba5d5
I20260812 11:21:36.519824 28999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:36.532089 28999 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:36.532899 28999 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:36.537525 28999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Generated new TSK 0
I20260812 11:21:36.538070 28999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:36.572326 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33361
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:36.678100 29045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:36.678304 29045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:36.678342 29045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:36.682147 29045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:36.682194 29045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:36.682246 29045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:36.687124 29045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:36.687943 29045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:36.688779 29045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:36.697363 29059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:36.697364 29057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:36.697352 29056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:36.697710 29045 server_base.cc:1034] running on GCE node
I20260812 11:21:36.698035 29045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:36.698556 29045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:36.699708 29045 hybrid_clock.cc:648] HybridClock initialized: now 1786533696699694 us; error 30 us; skew 500 ppm
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:36.702179 29045 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:36.702945 29045 webserver.cc:460] Webserver started at http://127.12.175.193:45005/ using document root <none> and password file <none>
I20260812 11:21:36.703480 29045 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:36.703547 29045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:36.703722 29045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:36.705561 29045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "a1060bd989b543abad51f3a4643bd1dd"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "05796e0797b3fd6f308f9504ae18f10d"
server_key_iv: "06ed403d1bd65a662c009d3b020a4d9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.706074 29045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "a1060bd989b543abad51f3a4643bd1dd"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "05796e0797b3fd6f308f9504ae18f10d"
server_key_iv: "06ed403d1bd65a662c009d3b020a4d9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.709510 29045 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:36.711809 29085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.712873 29045 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:36.712985 29045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "a1060bd989b543abad51f3a4643bd1dd"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "05796e0797b3fd6f308f9504ae18f10d"
server_key_iv: "06ed403d1bd65a662c009d3b020a4d9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.713085 29045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:36.726256 29045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:36.728717 29045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:36.728876 29045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:36.729388 29045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:36.730147 29045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:36.730195 29045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.730242 29045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:36.730271 29045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.738655 29045 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:42509
I20260812 11:21:36.738709 29340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:42509 every 8 connection(s)
I20260812 11:21:36.739492 29045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:36.747507 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 29045
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:36.747635 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:36.747893 12991 external_mini_cluster.cc:1428] Setting key 2f53442dbd99d7451aa5bf2e8432db27
I20260812 11:21:36.751442 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:36.741074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:43271 (local address 127.12.175.254:33361)
0812 11:21:36.741198 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:36.741203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:36.741949 (+ 746us) server_negotiation.cc:407] Connection header received
0812 11:21:36.743077 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:36.743079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:36.743124 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:36.743192 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:36.744227 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.744739 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.745773 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.745989 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.746062 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:36.748194 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:36.748198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:36.748201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:36.748231 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:36.749562 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:36.750020 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:36.750023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:36.750024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:36.750105 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:36.750412 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:36.750416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:36.750417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:36.750600 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:36.750687 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:36.751142 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 11:21:36.751286 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:36.752125 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:36.741375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:43271)
0812 11:21:36.741791 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:36.741831 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:36.742896 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:36.743351 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:36.743358 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:36.743670 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:36.744111 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:36.744124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.744826 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.744828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:36.745682 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:36.745691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.746097 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.746099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:36.746228 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:36.746664 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:36.746679 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:36.748041 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:36.749672 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:36.749678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:36.749691 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:36.749924 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:36.750189 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:36.750192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:36.750195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:36.750324 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:36.750702 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:36.750708 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:36.750918 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 11:21:36.751084 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 11:21:36.751395 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":108,"threads_started":1}
I20260812 11:21:36.753234 29343 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33361
I20260812 11:21:36.753432 29343 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:36.753842 29343 heartbeater.cc:511] Master 127.12.175.254:33361 requested a full tablet report, sending...
I20260812 11:21:36.755424 28895 ts_manager.cc:194] Registered new tserver with Master: a1060bd989b543abad51f3a4643bd1dd (127.12.175.193:42509)
I20260812 11:21:36.756925 28895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:43271
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:36.774333 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33361
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:36.880256 29354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:36.880461 29354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:36.880498 29354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:36.884428 29354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:36.884475 29354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:36.884527 29354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:36.889345 29354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:36.890132 29354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:36.890936 29354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:36.899608 29371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:36.899665 29354 server_base.cc:1034] running on GCE node
W20260812 11:21:36.899595 29363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:36.899598 29366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:36.900185 29354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:36.900733 29354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:36.901891 29354 hybrid_clock.cc:648] HybridClock initialized: now 1786533696901868 us; error 25 us; skew 500 ppm
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:36.904362 29354 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:36.905107 29354 webserver.cc:460] Webserver started at http://127.12.175.194:37689/ using document root <none> and password file <none>
I20260812 11:21:36.905582 29354 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:36.905646 29354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:36.905819 29354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:36.907678 29354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "854b8ea209054d1bb39b5433fff0390d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "be74d7dc86432d737a749e3398c2bf75"
server_key_iv: "60f4c35e81c5193bc03dcb20d0a0b5c3"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.908182 29354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "854b8ea209054d1bb39b5433fff0390d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "be74d7dc86432d737a749e3398c2bf75"
server_key_iv: "60f4c35e81c5193bc03dcb20d0a0b5c3"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.911679 29354 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:36.913815 29383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.914925 29354 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:36.915024 29354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "854b8ea209054d1bb39b5433fff0390d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "be74d7dc86432d737a749e3398c2bf75"
server_key_iv: "60f4c35e81c5193bc03dcb20d0a0b5c3"
server_key_version: "encryptionkey@0"
I20260812 11:21:36.915115 29354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:36.927310 29354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:36.929673 29354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:36.929807 29354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:36.930244 29354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:36.930932 29354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:36.930979 29354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.931012 29354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:36.931032 29354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:36.938843 29354 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:42135
I20260812 11:21:36.938905 29629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:42135 every 8 connection(s)
I20260812 11:21:36.939646 29354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
Aug 12 11:21:36 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:36.949560 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 29354
I20260812 11:21:36.949692 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:36.950022 12991 external_mini_cluster.cc:1428] Setting key 945efdf6ac690759505eb419b2e8955f
I20260812 11:21:36.951880 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:36.941231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:46675 (local address 127.12.175.254:33361)
0812 11:21:36.941364 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:36.941367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:36.942104 (+ 737us) server_negotiation.cc:407] Connection header received
0812 11:21:36.943294 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:36.943297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:36.943353 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:36.943428 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:36.944486 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.945005 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.946086 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.946305 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.946392 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:36.948599 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:36.948602 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:36.948604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:36.948627 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:36.949856 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:36.950358 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:36.950362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:36.950364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:36.950447 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:36.950748 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:36.950750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:36.950752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:36.950959 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:36.951070 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:36.951606 (+ 536us) server_negotiation.cc:299] Negotiation successful
0812 11:21:36.951726 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:21:36.952555 29634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:36.941540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:46675)
0812 11:21:36.941958 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:36.941997 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:36.943084 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:36.943598 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:36.943604 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:36.943916 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:36.944348 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:36.944360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.945122 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.945124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:36.945962 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:36.945972 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:36.946435 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:36.946439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:36.946599 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:36.947077 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:36.947093 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:36.948441 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:36.949968 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:36.949973 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:36.949983 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:36.950261 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:36.950532 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:36.950535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:36.950537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:36.950678 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:36.951066 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:36.951071 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:36.951337 (+ 266us) client_negotiation.cc:769] Sending connection context
0812 11:21:36.951531 (+ 194us) client_negotiation.cc:240] Negotiation successful
0812 11:21:36.951819 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":103,"threads_started":1}
I20260812 11:21:36.953558 29630 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33361
I20260812 11:21:36.953794 29630 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:36.954298 29630 heartbeater.cc:511] Master 127.12.175.254:33361 requested a full tablet report, sending...
I20260812 11:21:36.955329 28895 ts_manager.cc:194] Registered new tserver with Master: 854b8ea209054d1bb39b5433fff0390d (127.12.175.194:42135)
I20260812 11:21:36.956018 28895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:46675
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:36.976191 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33361
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:37.082703 29638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:37.082937 29638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:37.082981 29638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:37.086862 29638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:37.086911 29638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:37.086982 29638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:37.091912 29638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:37.092789 29638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:37.093704 29638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:37.102519 29648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.102494 29647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.102576 29655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.102692 29638 server_base.cc:1034] running on GCE node
I20260812 11:21:37.103037 29638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:37.103636 29638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:37.104799 29638 hybrid_clock.cc:648] HybridClock initialized: now 1786533697104780 us; error 27 us; skew 500 ppm
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533697, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:37.107285 29638 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:37.108060 29638 webserver.cc:460] Webserver started at http://127.12.175.195:41341/ using document root <none> and password file <none>
I20260812 11:21:37.108547 29638 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:37.108620 29638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:37.108798 29638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:37.110803 29638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "b7cd5535c1d0425988ec34dea00f7d65"
format_stamp: "Formatted at 2026-08-12 11:21:37 on dist-test-slave-gjrz"
server_key: "42b9c9e36581b32124d2af71ec13f4f1"
server_key_iv: "73c549f7079b8b340b837c1268cf78be"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.111357 29638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "b7cd5535c1d0425988ec34dea00f7d65"
format_stamp: "Formatted at 2026-08-12 11:21:37 on dist-test-slave-gjrz"
server_key: "42b9c9e36581b32124d2af71ec13f4f1"
server_key_iv: "73c549f7079b8b340b837c1268cf78be"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.114759 29638 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:37.117242 29677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.118383 29638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:37.118507 29638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "b7cd5535c1d0425988ec34dea00f7d65"
format_stamp: "Formatted at 2026-08-12 11:21:37 on dist-test-slave-gjrz"
server_key: "42b9c9e36581b32124d2af71ec13f4f1"
server_key_iv: "73c549f7079b8b340b837c1268cf78be"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.118602 29638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:37.130956 29638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:37.133479 29638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:37.133611 29638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:37.134075 29638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:37.134761 29638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:37.134826 29638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.134871 29638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:37.134891 29638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.143100 29638 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:38351
I20260812 11:21:37.143133 29924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:38351 every 8 connection(s)
I20260812 11:21:37.143865 29638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:37.151284 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 29638
I20260812 11:21:37.151425 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:37.151731 12991 external_mini_cluster.cc:1428] Setting key 6893e3c94fab990b0ef8855bc639dedb
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533697, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:37.156004 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.145413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:56701 (local address 127.12.175.254:33361)
0812 11:21:37.145567 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.145572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.146333 (+ 761us) server_negotiation.cc:407] Connection header received
0812 11:21:37.147543 (+ 1210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.147546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.147598 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.147673 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.148693 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.149230 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.150251 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.150448 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.150512 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.153051 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:37.153060 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:37.153062 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:37.153086 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:37.154407 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:37.154823 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:37.154825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:37.154827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:37.154891 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:37.155135 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:37.155137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:37.155138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:37.155335 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:37.155409 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:37.155800 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 11:21:37.155893 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:21:37.156674 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.145748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:56701)
0812 11:21:37.146195 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.146234 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.147323 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.147819 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.147826 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.148133 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.148570 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.148583 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.149322 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.149325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.150164 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.150173 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.150556 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.150558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.150693 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.151184 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.151204 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.152892 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:37.154503 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:37.154508 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:37.154518 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:37.154750 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:37.154950 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:37.154952 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:37.154953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:37.155070 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:37.155412 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:37.155417 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:37.155625 (+ 208us) client_negotiation.cc:769] Sending connection context
0812 11:21:37.155765 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 11:21:37.155978 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":115,"threads_started":1}
I20260812 11:21:37.157575 29925 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33361
I20260812 11:21:37.157770 29925 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:37.158183 29925 heartbeater.cc:511] Master 127.12.175.254:33361 requested a full tablet report, sending...
I20260812 11:21:37.159065 28895 ts_manager.cc:194] Registered new tserver with Master: b7cd5535c1d0425988ec34dea00f7d65 (127.12.175.195:38351)
I20260812 11:21:37.159614 28895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:56701
I20260812 11:21:37.165050 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab.
Entry for principal oryx/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab.
WARNING: no policy specified for oryx/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab.
Entry for principal oryx/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab.
WARNING: no policy specified for oryx/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab.
Entry for principal oryx/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab.
I20260812 11:21:37.227566 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 29045
I20260812 11:21:37.240146 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 29354
I20260812 11:21:37.261250 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 29638
I20260812 11:21:37.271194 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 28832
I20260812 11:21:37.284020 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33361
--webserver_interface=127.12.175.254
--webserver_port=42887
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:33361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:37.389719 29942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:37.389935 29942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:37.389971 29942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:37.393739 29942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:37.393782 29942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:37.393800 29942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:37.393818 29942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:37.393832 29942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:37.398677 29942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:33361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=42887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:37.399477 29942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:37.400300 29942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:37.407922 29955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.407979 29954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.408134 29942 server_base.cc:1034] running on GCE node
W20260812 11:21:37.407923 29957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.408821 29942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:37.409789 29942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:37.410944 29942 hybrid_clock.cc:648] HybridClock initialized: now 1786533697410926 us; error 29 us; skew 500 ppm
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533697, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:37.413419 29942 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:37.414211 29942 webserver.cc:460] Webserver started at http://127.12.175.254:42887/ using document root <none> and password file <none>
I20260812 11:21:37.414681 29942 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:37.414745 29942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:37.418269 29942 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:37.420135 29982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.421236 29942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:37.421348 29942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "26efde72621042a19a4bd3003fbd178d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "33b44e6c91c35c2d315336fcc89c5c86"
server_key_iv: "ff8d4e9e963a552aec1ae6467d982f93"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.421811 29942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:37.442224 29942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:37.444722 29942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:37.444885 29942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:37.451453 29942 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:33361
I20260812 11:21:37.451467 30091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:33361 every 8 connection(s)
I20260812 11:21:37.452419 29942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:37.456429 30093 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:21:37.457927 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Bootstrap starting.
I20260812 11:21:37.459364 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 29942
I20260812 11:21:37.459779 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:42509
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:33361
--webserver_port=45005
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:37.473817 30093 log.cc:824] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:37.479846 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:21:37.480150 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Bootstrap complete.
I20260812 11:21:37.484177 30093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:37.484548 30093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26efde72621042a19a4bd3003fbd178d, State: Initialized, Role: FOLLOWER
I20260812 11:21:37.485013 30093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:37.485131 30093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:37.485193 30093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:37.485283 30093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:21:37.487030 30093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:37.487370 30093 leader_election.cc:302] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26efde72621042a19a4bd3003fbd178d; no voters:
I20260812 11:21:37.487640 30093 leader_election.cc:288] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:21:37.487730 30102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:21:37.487921 30102 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [term 2 LEADER]: Becoming Leader. State: Replica: 26efde72621042a19a4bd3003fbd178d, State: Running, Role: LEADER
I20260812 11:21:37.488266 30102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } }
I20260812 11:21:37.488790 30093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:37.489236 30102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26efde72621042a19a4bd3003fbd178d. Latest consensus state: current_term: 2 leader_uuid: "26efde72621042a19a4bd3003fbd178d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } } }
I20260812 11:21:37.489339 30102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:37.489545 30103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "26efde72621042a19a4bd3003fbd178d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26efde72621042a19a4bd3003fbd178d" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33361 } } }
I20260812 11:21:37.489660 30103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:37.489868 30111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:37.493119 30111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:37.493765 30111 catalog_manager.cc:1259] Loaded cluster ID: 3b05d8b589ca4677aff1dcde2b6ba5d5
I20260812 11:21:37.494132 30111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:37.496568 30111 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:37.497251 30111 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 26efde72621042a19a4bd3003fbd178d: Loaded TSK: 0
I20260812 11:21:37.498453 30111 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:21:37.571437 30098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:37.571653 30098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:37.571709 30098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:37.575580 30098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:37.575629 30098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:37.575700 30098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:37.580583 30098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.193.keytab
--principal=oryx/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:42509
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=45005
--tserver_master_addrs=127.12.175.254:33361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:37.581439 30098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:37.582336 30098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:37.591950 30153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.591956 30160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.591951 30155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.592531 30098 server_base.cc:1034] running on GCE node
I20260812 11:21:37.592954 30098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:37.593544 30098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:37.594700 30098 hybrid_clock.cc:648] HybridClock initialized: now 1786533697594672 us; error 47 us; skew 500 ppm
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533697, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:37.597324 30098 init.cc:377] Logged in from keytab as oryx/127.12.175.193@KRBTEST.COM (short username oryx)
I20260812 11:21:37.598134 30098 webserver.cc:460] Webserver started at http://127.12.175.193:45005/ using document root <none> and password file <none>
I20260812 11:21:37.598621 30098 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:37.598703 30098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:37.602241 30098 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:37.604772 30175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.605872 30098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:21:37.605973 30098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "a1060bd989b543abad51f3a4643bd1dd"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "05796e0797b3fd6f308f9504ae18f10d"
server_key_iv: "06ed403d1bd65a662c009d3b020a4d9f"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.606451 30098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:37.639338 30098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:37.642186 30098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:37.642349 30098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:37.642874 30098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:37.643664 30098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:37.643710 30098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.643751 30098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:37.643780 30098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.651889 30098 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:42509
I20260812 11:21:37.651921 30385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:42509 every 8 connection(s)
I20260812 11:21:37.652796 30098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:37.656605 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 30098
I20260812 11:21:37.657013 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:42135
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:33361
--webserver_port=37689
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:21:37.664871 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:37.654629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:58293 (local address 127.12.175.254:33361)
0812 11:21:37.655061 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.655080 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.655302 (+ 222us) server_negotiation.cc:407] Connection header received
0812 11:21:37.656677 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.656688 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.656984 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.657302 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.658417 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.659425 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.660533 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.660992 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.661152 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.664228 (+ 3076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:58293: BlockingRecv error: recv got EOF from 127.12.175.193:58293 (error 108)
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":94,"threads_started":1}
I20260812 11:21:37.664880 30393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.654702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:58293)
0812 11:21:37.655144 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.655184 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.656285 (+ 1101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.657419 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.657427 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.657818 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.658251 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.658266 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.659568 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.659572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.660419 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.660428 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.661140 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.661144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.661317 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.661839 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.661853 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.664001 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":121,"threads_started":1}
W20260812 11:21:37.665453 30387 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:33361 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.175.254:33361: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:37.670197 30393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.665814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:46973)
0812 11:21:37.665903 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.665916 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.665986 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.666200 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.666203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.666336 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.666418 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.666423 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.667078 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.667082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.667652 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.667660 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.668052 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.668056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.668137 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.668522 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.668532 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.670080 (+ 1548us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 11:21:37.670369 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:37.665910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:46973 (local address 127.12.175.254:33361)
0812 11:21:37.666027 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.666031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.666051 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:21:37.666082 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.666083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.666116 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.666176 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.666521 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.666985 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.667756 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.667960 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.668049 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.670188 (+ 2139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:46973: BlockingRecv error: recv got EOF from 127.12.175.193:46973 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:37.674825 30393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.670669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:50873)
0812 11:21:37.670800 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.670813 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.670878 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.671064 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.671067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.671195 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.671258 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.671286 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.671916 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.671919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.672407 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.672414 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.672794 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.672798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.672871 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.673251 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.673260 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.674718 (+ 1458us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260812 11:21:37.674894 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:37.670758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:50873 (local address 127.12.175.254:33361)
0812 11:21:37.670861 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.670865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.670876 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:37.670945 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.670947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.670982 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.671048 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.671370 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.671820 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.672506 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.672703 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.672783 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.674819 (+ 2036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:50873: BlockingRecv error: recv got EOF from 127.12.175.193:50873 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 11:21:37.675109 30387 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:21:37.765053 30399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:37.765260 30399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:37.765304 30399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:37.769243 30399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:37.769290 30399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:37.769357 30399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:37.774266 30399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.194.keytab
--principal=oryx/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:42135
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=37689
--tserver_master_addrs=127.12.175.254:33361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:37.775105 30399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:37.775987 30399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:37.784718 30421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.784730 30413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.784736 30416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.784861 30399 server_base.cc:1034] running on GCE node
I20260812 11:21:37.785300 30399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:37.785822 30399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:37.786978 30399 hybrid_clock.cc:648] HybridClock initialized: now 1786533697786956 us; error 28 us; skew 500 ppm
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533697, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:37.789525 30399 init.cc:377] Logged in from keytab as oryx/127.12.175.194@KRBTEST.COM (short username oryx)
I20260812 11:21:37.790318 30399 webserver.cc:460] Webserver started at http://127.12.175.194:37689/ using document root <none> and password file <none>
I20260812 11:21:37.790831 30399 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:37.790902 30399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:37.794407 30399 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:37.796285 30436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.797343 30399 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:37.797446 30399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "854b8ea209054d1bb39b5433fff0390d"
format_stamp: "Formatted at 2026-08-12 11:21:36 on dist-test-slave-gjrz"
server_key: "be74d7dc86432d737a749e3398c2bf75"
server_key_iv: "60f4c35e81c5193bc03dcb20d0a0b5c3"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.797925 30399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:37.813962 30399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:37.816401 30399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:37.816553 30399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:37.817103 30399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:37.817840 30399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:37.817886 30399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.817934 30399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:37.817963 30399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.826040 30399 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:42135
I20260812 11:21:37.826076 30661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:42135 every 8 connection(s)
I20260812 11:21:37.826908 30399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:37.833489 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 30399
I20260812 11:21:37.833873 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:38351
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:33361
--webserver_port=41341
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:21:37.836717 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:37.828448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:42425 (local address 127.12.175.254:33361)
0812 11:21:37.828577 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.828582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.829342 (+ 760us) server_negotiation.cc:407] Connection header received
0812 11:21:37.830469 (+ 1127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.830471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.830521 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.830588 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.831616 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.832129 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.833161 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.833382 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.833466 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.836596 (+ 3130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:42425: BlockingRecv error: recv got EOF from 127.12.175.194:42425 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:37.837145 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.828808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:42425)
0812 11:21:37.829206 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.829245 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.830293 (+ 1048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.830725 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.830731 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.831035 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.831507 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.831520 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.832220 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.832222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.833072 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.833081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.833523 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.833527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.833704 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.834193 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.834208 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.836439 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":98,"threads_started":1}
W20260812 11:21:37.837574 30662 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:33361 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.175.254:33361: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:37.842741 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.837934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:49605)
0812 11:21:37.838042 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.838055 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.838123 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.838339 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.838342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.838502 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.838624 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.838631 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.839316 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.839320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.840129 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.840140 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.840528 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.840531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.840630 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.840992 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.841006 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.842628 (+ 1622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:21:37.842867 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:37.838037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:49605 (local address 127.12.175.254:33361)
0812 11:21:37.838131 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.838134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.838145 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:21:37.838200 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.838201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.838235 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.838294 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.838733 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.839200 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.840236 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.840433 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.840504 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.842764 (+ 2260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:49605: BlockingRecv error: recv got EOF from 127.12.175.194:49605 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:37.848582 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:37.843225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:48279)
0812 11:21:37.843442 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:37.843455 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:37.843530 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:37.843736 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:37.843739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:37.843872 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:37.843933 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.843937 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.844728 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.844732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.845514 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:37.845525 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.846146 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.846150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:37.846352 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.846775 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:37.846788 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:37.848477 (+ 1689us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164}
W20260812 11:21:37.848795 30662 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:21:37.848922 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:37.843343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:48279 (local address 127.12.175.254:33361)
0812 11:21:37.843442 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:37.843446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:37.843494 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:21:37.843611 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:37.843614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:37.843651 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:37.843712 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:37.844031 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.844610 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.845662 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:37.846024 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:37.846126 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:37.848606 (+ 2480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:48279: BlockingRecv error: recv got EOF from 127.12.175.194:48279 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 11:21:37.942493 30669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:37.942691 30669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:37.942730 30669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:37.946600 30669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:37.946662 30669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:37.946729 30669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:37.951643 30669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/krb5kdc/oryx_127.12.175.195.keytab
--principal=oryx/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:38351
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=41341
--tserver_master_addrs=127.12.175.254:33361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:37.952442 30669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:37.953282 30669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:37.961974 30681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:37.961982 30680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.962113 30669 server_base.cc:1034] running on GCE node
W20260812 11:21:37.961974 30686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:37.962579 30669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:37.963136 30669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:37.964290 30669 hybrid_clock.cc:648] HybridClock initialized: now 1786533697964275 us; error 35 us; skew 500 ppm
Aug 12 11:21:37 dist-test-slave-gjrz krb5kdc[28810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533697, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:37.966681 30669 init.cc:377] Logged in from keytab as oryx/127.12.175.195@KRBTEST.COM (short username oryx)
I20260812 11:21:37.967479 30669 webserver.cc:460] Webserver started at http://127.12.175.195:41341/ using document root <none> and password file <none>
I20260812 11:21:37.967935 30669 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:37.968003 30669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:37.971344 30669 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 11:21:37.973178 30697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.974231 30669 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:37.974323 30669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "b7cd5535c1d0425988ec34dea00f7d65"
format_stamp: "Formatted at 2026-08-12 11:21:37 on dist-test-slave-gjrz"
server_key: "42b9c9e36581b32124d2af71ec13f4f1"
server_key_iv: "73c549f7079b8b340b837c1268cf78be"
server_key_version: "encryptionkey@0"
I20260812 11:21:37.974812 30669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:37.995637 30669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:37.997924 30669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:37.998078 30669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:37.998554 30669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:37.999359 30669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:37.999405 30669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:37.999445 30669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:37.999475 30669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:38.007737 30669 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:38351
I20260812 11:21:38.007766 30931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:38351 every 8 connection(s)
I20260812 11:21:38.008577 30669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:38.010679 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 30669
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:21:38.019856 30392 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:38.010169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:39653 (local address 127.12.175.254:33361)
0812 11:21:38.010292 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:38.010295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:38.011156 (+ 861us) server_negotiation.cc:407] Connection header received
0812 11:21:38.012995 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:38.012998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:38.013058 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:38.013124 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:38.014425 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.015077 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.016613 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.016819 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.016901 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.019735 (+ 2834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:39653: BlockingRecv error: recv got EOF from 127.12.175.195:39653 (error 108)
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":46}
I20260812 11:21:38.020048 30943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:38.011579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33354 (local address 127.12.175.254:33361)
0812 11:21:38.011765 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:38.011768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:38.011781 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:38.011820 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:38.011821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:38.011861 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:38.011937 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:38.012793 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.013299 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.014448 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.014780 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.014875 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.016327 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:38.016332 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:38.016346 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:38.016373 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:38.018023 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:38.018450 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:38.018456 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:38.018462 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:38.018586 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:38.018846 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:38.018849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:38.018851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:38.019201 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:38.019406 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:38.019667 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 11:21:38.019897 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":52,"threads_started":1}
I20260812 11:21:38.020526 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:38.010558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:39653)
0812 11:21:38.011014 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:38.011064 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:38.012809 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:38.013300 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:38.013306 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:38.013732 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:38.014295 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.014313 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.015194 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.015198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.016472 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.016484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.016951 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.016955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.017138 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.017518 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:38.017533 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:38.019625 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":107,"threads_started":1}
W20260812 11:21:38.021189 30938 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:33361 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.175.254:33361: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:38.025974 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:38.021561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:39569)
0812 11:21:38.021734 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:38.021748 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:38.021816 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:38.022119 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:38.022122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:38.022256 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:38.022332 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.022338 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.023051 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.023055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.023605 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.023613 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.024013 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.024016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.024106 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.024416 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:38.024427 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:38.025870 (+ 1443us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113}
W20260812 11:21:38.026087 30943 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:38.021633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:39569 (local address 127.12.175.254:33361)
0812 11:21:38.021954 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:38.021957 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:38.021966 (+ 9us) server_negotiation.cc:407] Connection header received
0812 11:21:38.021991 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:38.021993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:38.022022 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:38.022087 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:38.022434 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.022944 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.023707 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.023923 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.024002 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.025997 (+ 1995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:39569: BlockingRecv error: recv got EOF from 127.12.175.195:39569 (error 108)
Metrics: {"server-negotiator.queue_time_us":258}
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:38.030391 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:38.026428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:58713)
0812 11:21:38.026526 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:38.026551 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:38.026624 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:38.026819 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:38.026822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:38.026949 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:38.027009 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.027013 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.027706 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.027710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.028192 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.028200 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.028580 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.028583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.028657 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.028956 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:38.028965 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:38.030314 (+ 1349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:21:38.030504 30943 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:38.026492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:58713 (local address 127.12.175.254:33361)
0812 11:21:38.026614 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:38.026617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:38.026630 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:38.026700 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:38.026702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:38.026735 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:38.026794 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:38.027107 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.027604 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.028290 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.028483 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.028564 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.030417 (+ 1853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:58713: BlockingRecv error: recv got EOF from 127.12.175.195:58713 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:21:38.030571 30938 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:38.680624 30944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:38.675641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:57475)
0812 11:21:38.675885 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:38.675898 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:38.675982 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:38.676204 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:38.676207 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:38.676373 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:38.676487 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.676492 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.677175 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.677177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.677777 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.677787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.678192 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.678196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.678282 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.678734 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:38.678745 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:38.680453 (+ 1708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":65,"threads_started":1}
W20260812 11:21:38.680716 30945 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:38.675707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:57475 (local address 127.12.175.254:33361)
0812 11:21:38.675933 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:38.675936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:38.675949 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:38.676066 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:38.676069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:38.676111 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:38.676182 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:38.676569 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.677099 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.677870 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.678104 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.678179 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.680600 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:57475: BlockingRecv error: recv got EOF from 127.12.175.193:57475 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":84,"threads_started":1}
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:38 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:38.855043 30947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:38.849370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:38911)
0812 11:21:38.849987 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:38.850000 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:38.850111 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:38.850492 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:38.850495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:38.850671 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:38.850768 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.850774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.851605 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.851609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.852222 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:38.852232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.852667 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.852671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:38.852758 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.853258 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:38.853273 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:38.854892 (+ 1619us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":68,"threads_started":1}
W20260812 11:21:38.855149 30945 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:38.849427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:38911 (local address 127.12.175.254:33361)
0812 11:21:38.849572 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:38.849577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:38.850071 (+ 494us) server_negotiation.cc:407] Connection header received
0812 11:21:38.850317 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:38.850320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:38.850373 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:38.850441 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:38.850885 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.851483 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.852334 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:38.852564 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:38.852652 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:38.855039 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:38911: BlockingRecv error: recv got EOF from 127.12.175.194:38911 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 11:21:39 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:39 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:39.035847 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:39.031078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:40711)
0812 11:21:39.031336 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:39.031350 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:39.031438 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:39.031639 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:39.031641 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:39.031801 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:39.031894 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:39.031899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.032565 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.032567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:39.033115 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:39.033121 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.033471 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.033473 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:39.033529 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:39.033942 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:39.033953 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:39.035699 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":61,"threads_started":1}
W20260812 11:21:39.035938 30945 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:39.031160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40711 (local address 127.12.175.254:33361)
0812 11:21:39.031302 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:39.031306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:39.031407 (+ 101us) server_negotiation.cc:407] Connection header received
0812 11:21:39.031505 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:39.031508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:39.031550 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:39.031617 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:39.031973 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.032491 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.033192 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.033398 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.033462 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:39.035837 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:40711: BlockingRecv error: recv got EOF from 127.12.175.195:40711 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 11:21:39 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:39 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:39.686209 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:39.681340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:56919)
0812 11:21:39.681586 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:39.681599 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:39.681692 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:39.681909 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:39.681911 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:39.682094 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:39.682194 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:39.682200 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.682872 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.682873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:39.683458 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:39.683466 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.683829 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.683831 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:39.683888 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:39.684321 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:39.684332 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:39.686057 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":68,"threads_started":1}
W20260812 11:21:39.686319 30952 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:39.681399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:56919 (local address 127.12.175.254:33361)
0812 11:21:39.681608 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:39.681611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:39.681643 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:21:39.681758 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:39.681760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:39.681802 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:39.681890 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:39.682276 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.682794 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.683534 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.683750 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.683821 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:39.686207 (+ 2386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:56919: BlockingRecv error: recv got EOF from 127.12.175.193:56919 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":66,"threads_started":1}
Aug 12 11:21:39 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:39 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:39.860409 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:39.855638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:35563)
0812 11:21:39.855890 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:39.855904 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:39.855994 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:39.856187 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:39.856189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:39.856352 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:39.856447 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:39.856452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.857118 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.857120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:39.857673 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:39.857680 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.858024 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.858026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:39.858082 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:39.858481 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:39.858491 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:39.860234 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":82,"threads_started":1}
W20260812 11:21:39.860473 30952 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:39.855699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:35563 (local address 127.12.175.254:33361)
0812 11:21:39.855817 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:39.855821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:39.855959 (+ 138us) server_negotiation.cc:407] Connection header received
0812 11:21:39.856054 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:39.856056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:39.856099 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:39.856164 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:39.856524 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.857034 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.857747 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:39.857949 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:39.858014 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:39.860375 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:35563: BlockingRecv error: recv got EOF from 127.12.175.194:35563 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 11:21:40 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:40 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:40.047094 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:40.036602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:36741)
0812 11:21:40.036900 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:40.036916 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:40.037035 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:40.037288 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:40.037291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:40.037487 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:40.037582 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:40.037589 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.038332 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.038335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:40.038920 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:40.038929 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.039396 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.039400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:40.039486 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:40.045232 (+ 5746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:40.045245 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:40.046954 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":80,"threads_started":1}
W20260812 11:21:40.047187 30952 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:40.036735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:36741 (local address 127.12.175.254:33361)
0812 11:21:40.036894 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:40.036898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:40.036990 (+ 92us) server_negotiation.cc:407] Connection header received
0812 11:21:40.037135 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:40.037138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:40.037187 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:40.037251 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:40.037703 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.038225 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.039041 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.039294 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.039397 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:40.047089 (+ 7692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:36741: BlockingRecv error: recv got EOF from 127.12.175.195:36741 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 11:21:40 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:40 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:40.692126 30962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:40.687006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:50575)
0812 11:21:40.687255 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:40.687289 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:40.687381 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:40.687585 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:40.687587 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:40.687751 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:40.687850 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:40.687856 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.688618 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.688621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:40.689191 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:40.689199 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.689709 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.689711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:40.689777 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:40.690208 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:40.690219 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:40.691966 (+ 1747us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
W20260812 11:21:40.692256 30963 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:40.687099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:50575 (local address 127.12.175.254:33361)
0812 11:21:40.687387 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:40.687390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:40.687404 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:40.687453 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:40.687454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:40.687494 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:40.687562 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:40.687935 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.688527 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.689334 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.689606 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.689681 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:40.692120 (+ 2439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:50575: BlockingRecv error: recv got EOF from 127.12.175.193:50575 (error 108)
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":114,"threads_started":1}
Aug 12 11:21:40 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:40 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:40.865875 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:40.861123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:52659)
0812 11:21:40.861448 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:40.861460 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:40.861552 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:40.861756 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:40.861758 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:40.861936 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:40.862032 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:40.862048 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.862706 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.862708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:40.863285 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:40.863295 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.863658 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.863660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:40.863721 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:40.864129 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:40.864139 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:40.865764 (+ 1625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":70,"threads_started":1}
W20260812 11:21:40.865998 30963 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:40.861192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:52659 (local address 127.12.175.254:33361)
0812 11:21:40.861322 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:40.861327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:40.861525 (+ 198us) server_negotiation.cc:407] Connection header received
0812 11:21:40.861621 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:40.861623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:40.861669 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:40.861733 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:40.862122 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.862628 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.863371 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:40.863581 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:40.863648 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:40.865894 (+ 2246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:52659: BlockingRecv error: recv got EOF from 127.12.175.194:52659 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 11:21:41 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:41 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:41.052930 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:41.047827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:49419)
0812 11:21:41.048072 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:41.048085 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:41.048181 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:41.048383 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:41.048385 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:41.048562 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:41.048660 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:41.048665 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.049484 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.049486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:41.050141 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:41.050153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.050557 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.050559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:41.050618 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:41.051025 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:41.051037 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:41.052813 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":68,"threads_started":1}
W20260812 11:21:41.053035 30963 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:41.047890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:49419 (local address 127.12.175.254:33361)
0812 11:21:41.048011 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:41.048014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:41.048145 (+ 131us) server_negotiation.cc:407] Connection header received
0812 11:21:41.048251 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:41.048253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:41.048298 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:41.048360 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:41.048740 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.049377 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.050241 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.050460 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.050534 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:41.052938 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:49419: BlockingRecv error: recv got EOF from 127.12.175.195:49419 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 11:21:41 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:41 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:41.698030 30966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:41.693164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:32909)
0812 11:21:41.693442 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:41.693457 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:41.693571 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:41.693856 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:41.693859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:41.694027 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:41.694131 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:41.694137 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.694827 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.694829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:41.695389 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:41.695396 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.695766 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.695768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:41.695825 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:41.696298 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:41.696309 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:41.697916 (+ 1607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":82,"threads_started":1}
W20260812 11:21:41.698181 30970 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:41.693198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:32909 (local address 127.12.175.254:33361)
0812 11:21:41.693433 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:41.693437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:41.693525 (+ 88us) server_negotiation.cc:407] Connection header received
0812 11:21:41.693657 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:41.693661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:41.693716 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:41.693810 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:41.694223 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.694751 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.695465 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.695689 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.695758 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:41.698050 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:32909: BlockingRecv error: recv got EOF from 127.12.175.193:32909 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":58,"threads_started":1}
Aug 12 11:21:41 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:41 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:41.871515 30975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:41.866519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:44681)
0812 11:21:41.866765 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:41.866777 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:41.866868 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:41.867099 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:41.867101 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:41.867291 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:41.867397 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:41.867403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.868129 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.868131 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:41.868680 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:41.868686 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.869105 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.869107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:41.869166 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:41.869600 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:41.869610 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:41.871363 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
W20260812 11:21:41.871593 30970 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:41.866585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:44681 (local address 127.12.175.254:33361)
0812 11:21:41.866705 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:41.866709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:41.866825 (+ 116us) server_negotiation.cc:407] Connection header received
0812 11:21:41.866960 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:41.866962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:41.867005 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:41.867067 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:41.867505 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.868046 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.868773 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:41.869014 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:41.869087 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:41.871494 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:44681: BlockingRecv error: recv got EOF from 127.12.175.194:44681 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 11:21:42 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:42 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:42.058547 30976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.053631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:42535)
0812 11:21:42.053884 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.053897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:42.053991 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:42.054199 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:42.054201 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:42.054369 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:42.054466 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:42.054471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.055146 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.055149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:42.055726 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:42.055733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.056159 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.056162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:42.056222 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:42.056661 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:42.056672 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:42.058393 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":90,"threads_started":1}
W20260812 11:21:42.058629 30970 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:42.053688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:42535 (local address 127.12.175.254:33361)
0812 11:21:42.053819 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:42.053824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:42.053974 (+ 150us) server_negotiation.cc:407] Connection header received
0812 11:21:42.054062 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:42.054064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:42.054110 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:42.054172 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:42.054546 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.055071 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.055831 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.056072 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.056150 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:42.058527 (+ 2377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:42535: BlockingRecv error: recv got EOF from 127.12.175.195:42535 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 11:21:42 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:42 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:42.703851 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.698717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:48895)
0812 11:21:42.698983 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.698997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:42.699092 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:42.699312 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:42.699315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:42.699505 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:42.699607 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:42.699613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.700297 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.700299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:42.700908 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:42.700917 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.701339 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.701342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:42.701442 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:42.701953 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:42.701965 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:42.703706 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":72,"threads_started":1}
W20260812 11:21:42.703954 30979 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:42.698790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:48895 (local address 127.12.175.254:33361)
0812 11:21:42.699055 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:42.699059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:42.699073 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:21:42.699158 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:42.699160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:42.699201 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:42.699312 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:42.699695 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.700221 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.700999 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.701237 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.701311 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:42.703841 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:48895: BlockingRecv error: recv got EOF from 127.12.175.193:48895 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":104,"threads_started":1}
Aug 12 11:21:42 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:42 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:42.877609 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.872296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:45441)
0812 11:21:42.872558 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.872572 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:42.872672 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:42.872910 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:42.872913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:42.873112 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:42.873207 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:42.873213 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.873946 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.873950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:42.874513 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:42.874522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.874964 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.874968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:42.875053 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:42.875535 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:42.875555 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:42.877453 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":80,"threads_started":1}
W20260812 11:21:42.877671 30979 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:42.872418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:45441 (local address 127.12.175.254:33361)
0812 11:21:42.872556 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:42.872560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:42.872625 (+ 65us) server_negotiation.cc:407] Connection header received
0812 11:21:42.872760 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:42.872763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:42.872812 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:42.872875 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:42.873320 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.873845 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.874633 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:42.874864 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:42.874950 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:42.877574 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:45441: BlockingRecv error: recv got EOF from 127.12.175.194:45441 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 11:21:43 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:43 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:43.064072 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:43.059289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:34807)
0812 11:21:43.059533 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:43.059546 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:43.059652 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:43.059850 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:43.059852 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:43.060034 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:43.060128 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:43.060133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.060793 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.060795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:43.061337 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:43.061344 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.061693 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.061696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:43.061753 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:43.062188 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:43.062199 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:43.063927 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":80,"threads_started":1}
W20260812 11:21:43.064270 30979 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:43.059334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:34807 (local address 127.12.175.254:33361)
0812 11:21:43.059467 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:43.059471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:43.059619 (+ 148us) server_negotiation.cc:407] Connection header received
0812 11:21:43.059720 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:43.059722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:43.059766 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:43.059827 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:43.060205 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.060720 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.061412 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.061621 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.061686 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:43.064069 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:34807: BlockingRecv error: recv got EOF from 127.12.175.195:34807 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 11:21:43 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:43 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:43.709714 30985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:43.704517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:38347)
0812 11:21:43.704797 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:43.704815 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:43.704946 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:43.705195 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:43.705197 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:43.705374 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:43.705477 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:43.705482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.706206 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.706208 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:43.706760 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:43.706767 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.707165 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.707168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:43.707238 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:43.707801 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:43.707813 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:43.709544 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":87,"threads_started":1}
W20260812 11:21:43.709828 30986 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:43.704595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:38347 (local address 127.12.175.254:33361)
0812 11:21:43.704814 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:43.704817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:43.704881 (+ 64us) server_negotiation.cc:407] Connection header received
0812 11:21:43.705017 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:43.705019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:43.705065 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:43.705136 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:43.705591 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.706122 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.706838 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.707057 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.707120 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:43.709713 (+ 2593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:38347: BlockingRecv error: recv got EOF from 127.12.175.193:38347 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":58,"threads_started":1}
Aug 12 11:21:43 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:43 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:43.883510 30987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:43.878396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:60311)
0812 11:21:43.878653 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:43.878668 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:43.878766 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:43.878987 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:43.878989 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:43.879206 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:43.879329 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:43.879336 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.880030 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.880032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:43.880588 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:43.880595 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.880944 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.880946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:43.881004 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:43.881418 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:43.881428 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:43.883395 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":73,"threads_started":1}
W20260812 11:21:43.883623 30986 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:43.878446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:60311 (local address 127.12.175.254:33361)
0812 11:21:43.878570 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:43.878574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:43.878725 (+ 151us) server_negotiation.cc:407] Connection header received
0812 11:21:43.878830 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:43.878832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:43.878896 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:43.878971 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:43.879431 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.879951 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.880670 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:43.880871 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:43.880934 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:43.883510 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:60311: BlockingRecv error: recv got EOF from 127.12.175.194:60311 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 11:21:44 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:44 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:44.069871 30988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:44.064821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:48531)
0812 11:21:44.065142 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:44.065155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:44.065252 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:44.065479 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:44.065482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:44.065674 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:44.065771 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:44.065777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.066483 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.066486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:44.067049 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:44.067058 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.067514 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.067516 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:44.067588 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:44.068013 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:44.068024 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:44.069710 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":159,"threads_started":1}
W20260812 11:21:44.069950 30986 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:44.064919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:48531 (local address 127.12.175.254:33361)
0812 11:21:44.065083 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:44.065088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:44.065216 (+ 128us) server_negotiation.cc:407] Connection header received
0812 11:21:44.065331 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:44.065333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:44.065380 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:44.065457 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:44.065857 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.066380 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.067170 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.067425 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.067505 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:44.069849 (+ 2344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:48531: BlockingRecv error: recv got EOF from 127.12.175.195:48531 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 11:21:44 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:44 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:44.715379 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:44.710471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:45365)
0812 11:21:44.710779 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:44.710792 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:44.710890 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:44.711098 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:44.711100 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:44.711296 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:44.711391 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:44.711396 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.712082 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.712085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:44.712635 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:44.712641 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.712990 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.712992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:44.713060 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:44.713537 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:44.713549 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:44.715230 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":76,"threads_started":1}
W20260812 11:21:44.715533 30990 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:44.710533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:45365 (local address 127.12.175.254:33361)
0812 11:21:44.710784 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:44.710788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:44.710847 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:21:44.710952 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:44.710954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:44.710996 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:44.711076 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:44.711478 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.712003 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.712709 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.712919 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.712983 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:44.715400 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:45365: BlockingRecv error: recv got EOF from 127.12.175.193:45365 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
Aug 12 11:21:44 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:44 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:44.889437 30994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:44.884205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:54915)
0812 11:21:44.884529 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:44.884542 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:44.884670 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:44.884962 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:44.884966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:44.885195 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:44.885324 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:44.885334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.886116 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.886118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:44.886682 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:44.886690 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.887044 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.887047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:44.887105 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:44.887543 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:44.887564 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:44.889325 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":99,"threads_started":1}
W20260812 11:21:44.889633 30990 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:44.884277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:54915 (local address 127.12.175.254:33361)
0812 11:21:44.884427 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:44.884432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:44.884629 (+ 197us) server_negotiation.cc:407] Connection header received
0812 11:21:44.884779 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:44.884782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:44.884839 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:44.884915 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:44.885439 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.886009 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.886766 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:44.886971 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:44.887034 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:44.889446 (+ 2412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:54915: BlockingRecv error: recv got EOF from 127.12.175.194:54915 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 11:21:45 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:45 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:45.079867 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:45.070612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:59355)
0812 11:21:45.070902 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:45.070915 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:45.071012 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:45.071251 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:45.071253 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:45.071460 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:45.071560 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:45.071566 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.072237 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.072239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:45.072785 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:45.072791 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.073139 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.073141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:45.073199 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:45.077911 (+ 4712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:45.077930 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:45.079754 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":80,"threads_started":1}
W20260812 11:21:45.080014 30990 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:45.070677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:59355 (local address 127.12.175.254:33361)
0812 11:21:45.070803 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:45.070806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:45.070978 (+ 172us) server_negotiation.cc:407] Connection header received
0812 11:21:45.071102 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:45.071104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:45.071150 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:45.071214 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:45.071647 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.072156 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.072857 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.073065 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.073129 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:45.079892 (+ 6763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:59355: BlockingRecv error: recv got EOF from 127.12.175.195:59355 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 11:21:45 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:45 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:45.721094 30997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:45.716041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:36039)
0812 11:21:45.716294 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:45.716310 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:45.716402 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:45.716604 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:45.716606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:45.716776 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:45.716874 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:45.716879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.717547 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.717549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:45.718103 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:45.718110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.718484 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.718489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:45.718563 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:45.719074 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:45.719086 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:45.720934 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":67,"threads_started":1}
W20260812 11:21:45.721192 30999 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:45.716180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:36039 (local address 127.12.175.254:33361)
0812 11:21:45.716407 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:45.716411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:45.716423 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:45.716458 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:45.716460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:45.716501 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:45.716580 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:45.716954 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.717474 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.718181 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.718388 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.718451 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:45.721078 (+ 2627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:36039: BlockingRecv error: recv got EOF from 127.12.175.193:36039 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":73,"threads_started":1}
Aug 12 11:21:45 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:45 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:45.895284 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:45.890101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:38851)
0812 11:21:45.890378 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:45.890390 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:45.890495 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:45.890738 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:45.890741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:45.890935 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:45.891030 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:45.891043 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.891958 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.891962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:45.892529 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:45.892537 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.892960 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.892963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:45.893056 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:45.893495 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:45.893506 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:45.895146 (+ 1640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":104,"threads_started":1}
W20260812 11:21:45.895412 30999 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:45.890144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:38851 (local address 127.12.175.254:33361)
0812 11:21:45.890296 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:45.890300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:45.890455 (+ 155us) server_negotiation.cc:407] Connection header received
0812 11:21:45.890589 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:45.890592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:45.890637 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:45.890699 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:45.891149 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.891856 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.892642 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:45.892863 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:45.892947 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:45.895297 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:38851: BlockingRecv error: recv got EOF from 127.12.175.194:38851 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 11:21:46 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:46 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:46.085623 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:46.080502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:46823)
0812 11:21:46.080778 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:46.080792 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:46.080891 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:46.081100 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:46.081103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:46.081279 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:46.081376 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:46.081382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.082050 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.082052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:46.082662 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:46.082674 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.083093 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.083096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:46.083154 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:46.083614 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:46.083625 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:46.085474 (+ 1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":112,"threads_started":1}
W20260812 11:21:46.085711 30999 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:46.080588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:46823 (local address 127.12.175.254:33361)
0812 11:21:46.080707 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:46.080711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:46.080850 (+ 139us) server_negotiation.cc:407] Connection header received
0812 11:21:46.080958 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:46.080960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:46.081005 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:46.081067 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:46.081455 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.081975 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.082775 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.083001 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.083075 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:46.085610 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:46823: BlockingRecv error: recv got EOF from 127.12.175.195:46823 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 11:21:46 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:46 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:46.727339 31006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:46.721810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:59639)
0812 11:21:46.722094 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:46.722108 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:46.722203 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:46.722443 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:46.722446 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:46.722641 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:46.722744 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:46.722750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.723715 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.723718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:46.724280 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:46.724288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.724754 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.724757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:46.724830 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:46.725315 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:46.725327 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:46.727185 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":82,"threads_started":1}
W20260812 11:21:46.727475 31007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:46.721898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:59639 (local address 127.12.175.254:33361)
0812 11:21:46.722147 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:46.722150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:46.722163 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:46.722270 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:46.722272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:46.722314 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:46.722397 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:46.722835 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.723614 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.724366 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.724637 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.724709 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:46.727343 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:59639: BlockingRecv error: recv got EOF from 127.12.175.193:59639 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":99,"threads_started":1}
Aug 12 11:21:46 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:46 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:46.900720 31011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:46.895912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:39735)
0812 11:21:46.896168 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:46.896180 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:46.896273 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:46.896471 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:46.896473 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:46.896643 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:46.896737 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:46.896743 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.897401 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.897422 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:46.898003 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:46.898011 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.898386 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.898388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:46.898446 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:46.898872 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:46.898883 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:46.900575 (+ 1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
W20260812 11:21:46.900806 31007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:46.895974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39735 (local address 127.12.175.254:33361)
0812 11:21:46.896114 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:46.896118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:46.896230 (+ 112us) server_negotiation.cc:407] Connection header received
0812 11:21:46.896349 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:46.896351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:46.896394 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:46.896448 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:46.896816 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.897328 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.898095 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:46.898307 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:46.898377 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:46.900702 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:39735: BlockingRecv error: recv got EOF from 127.12.175.194:39735 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 11:21:47 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:47 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:47.091799 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:47.086311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:47491)
0812 11:21:47.086590 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:47.086603 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:47.086716 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:47.086958 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:47.086961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:47.087173 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:47.087298 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:47.087305 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.088044 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.088048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:47.088642 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:47.088651 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.089077 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.089081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:47.089171 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:47.089674 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:47.089688 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:47.091626 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":81,"threads_started":1}
W20260812 11:21:47.091878 31007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:47.086394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:47491 (local address 127.12.175.254:33361)
0812 11:21:47.086519 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:47.086523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:47.086672 (+ 149us) server_negotiation.cc:407] Connection header received
0812 11:21:47.086802 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:47.086805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:47.086853 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:47.086919 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:47.087417 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.087941 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.088751 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.088968 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.089055 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:47.091760 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:47491: BlockingRecv error: recv got EOF from 127.12.175.195:47491 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 11:21:47 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:47 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:47.732915 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:47.728062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:37983)
0812 11:21:47.728344 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:47.728357 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:47.728443 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:47.728669 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:47.728671 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:47.728844 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:47.728945 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:47.728950 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.729642 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.729644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:47.730204 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:47.730212 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.730610 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.730612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:47.730667 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:47.731108 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:47.731119 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:47.732790 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":90,"threads_started":1}
W20260812 11:21:47.733047 31014 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:47.728131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:37983 (local address 127.12.175.254:33361)
0812 11:21:47.728378 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:47.728382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:47.728397 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:21:47.728519 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:47.728521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:47.728571 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:47.728644 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:47.729026 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.729555 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.730296 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.730522 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.730603 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:47.732917 (+ 2314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:37983: BlockingRecv error: recv got EOF from 127.12.175.193:37983 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":74,"threads_started":1}
Aug 12 11:21:47 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:47 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:47.906508 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:47.901415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:53431)
0812 11:21:47.901654 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:47.901667 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:47.901757 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:47.901967 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:47.901969 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:47.902182 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:47.902282 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:47.902289 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.902980 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.902983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:47.903588 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:47.903597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.903950 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.903952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:47.904007 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:47.904457 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:47.904467 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:47.906398 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":67,"threads_started":1}
W20260812 11:21:47.906632 31014 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:47.901467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:53431 (local address 127.12.175.254:33361)
0812 11:21:47.901603 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:47.901607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:47.901725 (+ 118us) server_negotiation.cc:407] Connection header received
0812 11:21:47.901826 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:47.901828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:47.901869 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:47.901942 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:47.902373 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.902893 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.903672 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:47.903875 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:47.903941 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:47.906523 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:53431: BlockingRecv error: recv got EOF from 127.12.175.194:53431 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 11:21:48 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:48 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:48.098004 31018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:48.092549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:49213)
0812 11:21:48.092820 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:48.092836 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:48.092949 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:48.093192 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:48.093195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:48.093395 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:48.093494 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:48.093501 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.094439 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.094444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:48.095051 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:48.095062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.095523 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.095527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:48.095623 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:48.096086 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:48.096098 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:48.097857 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
W20260812 11:21:48.098107 31014 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:48.092690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:49213 (local address 127.12.175.254:33361)
0812 11:21:48.092820 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:48.092824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:48.092903 (+ 79us) server_negotiation.cc:407] Connection header received
0812 11:21:48.093036 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:48.093039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:48.093090 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:48.093154 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:48.093612 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.094340 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.095169 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.095417 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.095505 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:48.097996 (+ 2491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:49213: BlockingRecv error: recv got EOF from 127.12.175.195:49213 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 11:21:48 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:48 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:48.738680 31019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:48.733625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:45093)
0812 11:21:48.733909 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:48.733922 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:48.734020 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:48.734252 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:48.734253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:48.734426 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:48.734523 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:48.734528 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.735241 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.735244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:48.735861 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:48.735870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.736269 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.736271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:48.736328 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:48.736772 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:48.736783 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:48.738568 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":94,"threads_started":1}
W20260812 11:21:48.738802 31020 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:48.733675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:45093 (local address 127.12.175.254:33361)
0812 11:21:48.733920 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:48.733924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:48.733974 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:21:48.734105 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:48.734107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:48.734151 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:48.734235 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:48.734614 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.735154 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.735957 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.736185 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.736263 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:48.738689 (+ 2426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:45093: BlockingRecv error: recv got EOF from 127.12.175.193:45093 (error 108)
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":70,"threads_started":1}
Aug 12 11:21:48 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:48 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:48.912689 31021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:48.907168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:55983)
0812 11:21:48.907440 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:48.907457 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:48.907565 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:48.907831 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:48.907833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:48.908002 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:48.908099 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:48.908105 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.908980 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.908984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:48.909753 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:48.909765 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.910188 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.910190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:48.910247 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:48.910774 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:48.910789 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:48.912574 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":114,"threads_started":1}
W20260812 11:21:48.912799 31020 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:48.907226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:55983 (local address 127.12.175.254:33361)
0812 11:21:48.907365 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:48.907369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:48.907517 (+ 148us) server_negotiation.cc:407] Connection header received
0812 11:21:48.907692 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:48.907694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:48.907745 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:48.907808 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:48.908182 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.908872 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.909857 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:48.910086 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:48.910197 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:48.912698 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:55983: BlockingRecv error: recv got EOF from 127.12.175.194:55983 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 11:21:49 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:49 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:49.104043 31022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:49.098693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:58937)
0812 11:21:49.099009 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:49.099024 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:49.099139 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:49.099425 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:49.099429 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:49.099643 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:49.099774 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:49.099783 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.100587 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.100591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:49.101180 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:49.101188 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.101699 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.101703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:49.101779 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:49.102249 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:49.102260 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:49.103908 (+ 1648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":87,"threads_started":1}
W20260812 11:21:49.104139 31020 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:49.098801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:58937 (local address 127.12.175.254:33361)
0812 11:21:49.098964 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:49.098969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:49.099093 (+ 124us) server_negotiation.cc:407] Connection header received
0812 11:21:49.099234 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:49.099236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:49.099306 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:49.099378 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:49.099882 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.100478 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.101311 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.101584 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.101660 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:49.104038 (+ 2378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:58937: BlockingRecv error: recv got EOF from 127.12.175.195:58937 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 11:21:49 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:49 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:49.744503 31023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:49.739427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:45519)
0812 11:21:49.739697 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:49.739711 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:49.739800 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:49.740018 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:49.740020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:49.740198 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:49.740298 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:49.740303 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.740981 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.740983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:49.741521 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:49.741526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.741898 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.741901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:49.741958 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:49.742378 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:49.742388 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:49.744388 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
W20260812 11:21:49.744652 31024 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:49.739481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:45519 (local address 127.12.175.254:33361)
0812 11:21:49.739734 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:49.739738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:49.739754 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:21:49.739874 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:49.739876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:49.739919 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:49.739988 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:49.740378 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.740907 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.741603 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.741814 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.741894 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:49.744514 (+ 2620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:45519: BlockingRecv error: recv got EOF from 127.12.175.193:45519 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":74,"threads_started":1}
Aug 12 11:21:49 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:49 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:49.918493 31026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:49.913326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:36557)
0812 11:21:49.913598 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:49.913611 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:49.913712 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:49.913922 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:49.913924 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:49.914096 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:49.914193 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:49.914198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.915018 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.915022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:49.915685 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:49.915698 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.916137 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.916141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:49.916230 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:49.916654 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:49.916664 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:49.918366 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":94,"threads_started":1}
W20260812 11:21:49.918630 31024 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:49.913426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:36557 (local address 127.12.175.254:33361)
0812 11:21:49.913588 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:49.913591 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:49.913673 (+ 82us) server_negotiation.cc:407] Connection header received
0812 11:21:49.913782 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:49.913784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:49.913827 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:49.913889 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:49.914273 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.914904 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.915801 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:49.916024 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:49.916114 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:49.918499 (+ 2385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:36557: BlockingRecv error: recv got EOF from 127.12.175.194:36557 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 11:21:50 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:50 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:50.114673 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:50.104797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:34653)
0812 11:21:50.105098 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:50.105111 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:50.105206 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:50.105458 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:50.105462 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:50.105697 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:50.105807 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:50.105815 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.106516 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.106518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:50.107085 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:50.107093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.107509 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.107512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:50.107577 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:50.112793 (+ 5216us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:50.112805 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:50.114550 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":133,"threads_started":1}
W20260812 11:21:50.114780 31024 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:50.104852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:34653 (local address 127.12.175.254:33361)
0812 11:21:50.104970 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:50.104975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:50.105179 (+ 204us) server_negotiation.cc:407] Connection header received
0812 11:21:50.105285 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:50.105288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:50.105340 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:50.105425 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:50.105908 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.106424 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.107168 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.107432 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.107504 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:50.114680 (+ 7176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:34653: BlockingRecv error: recv got EOF from 127.12.175.195:34653 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 11:21:50 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:50 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:50.750197 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:50.745168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:50095)
0812 11:21:50.745420 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:50.745434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:50.745535 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:50.745750 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:50.745752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:50.745936 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:50.746038 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:50.746043 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.746743 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.746745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:50.747373 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:50.747385 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.747822 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.747825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:50.747915 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:50.748413 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:50.748425 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:50.750081 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
W20260812 11:21:50.750350 31033 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:50.745217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:50095 (local address 127.12.175.254:33361)
0812 11:21:50.745441 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:50.745444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:50.745496 (+ 52us) server_negotiation.cc:407] Connection header received
0812 11:21:50.745604 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:50.745605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:50.745649 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:50.745726 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:50.746124 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.746644 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.747479 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.747719 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.747797 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:50.750218 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:50095: BlockingRecv error: recv got EOF from 127.12.175.193:50095 (error 108)
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":68,"threads_started":1}
Aug 12 11:21:50 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:50 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:50.924640 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:50.919153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:57743)
0812 11:21:50.919418 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:50.919431 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:50.919525 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:50.919728 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:50.919730 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:50.919903 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:50.919999 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:50.920004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.920689 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.920691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:50.921286 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:50.921297 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.921908 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.921913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:50.922002 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:50.922497 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:50.922512 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:50.924471 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":70,"threads_started":1}
W20260812 11:21:50.924712 31033 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:50.919298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:57743 (local address 127.12.175.254:33361)
0812 11:21:50.919428 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:50.919432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:50.919479 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:21:50.919595 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:50.919597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:50.919641 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:50.919705 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:50.920090 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.920611 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.921392 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:50.921772 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:50.921894 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:50.924612 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:57743: BlockingRecv error: recv got EOF from 127.12.175.194:57743 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 11:21:51 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:51 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:51.120702 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:51.115432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:40361)
0812 11:21:51.115772 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:51.115785 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:51.115907 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:51.116184 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:51.116186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:51.116388 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:51.116487 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:51.116494 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.117238 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.117242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:51.117835 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:51.117843 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.118279 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.118282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:51.118371 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:51.118831 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:51.118842 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:51.120555 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":71,"threads_started":1}
W20260812 11:21:51.120788 31033 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:51.115493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40361 (local address 127.12.175.254:33361)
0812 11:21:51.115629 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:51.115633 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:51.115850 (+ 217us) server_negotiation.cc:407] Connection header received
0812 11:21:51.116028 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:51.116031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:51.116080 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:51.116142 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:51.116605 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.117130 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.117950 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.118176 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.118262 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:51.120690 (+ 2428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:40361: BlockingRecv error: recv got EOF from 127.12.175.195:40361 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 11:21:51 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:51 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:51.755755 31040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:51.750873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:35535)
0812 11:21:51.751138 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:51.751151 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:51.751240 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:51.751471 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:51.751473 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:51.751651 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:51.751751 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:51.751756 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.752421 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.752423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:51.752980 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:51.752987 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.753351 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.753353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:51.753410 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:51.753872 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:51.753885 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:51.755642 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
W20260812 11:21:51.755892 31041 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:51.750905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:35535 (local address 127.12.175.254:33361)
0812 11:21:51.751189 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:51.751192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:51.751205 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:21:51.751328 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:51.751329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:51.751373 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:51.751445 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:51.751832 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.752349 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.753063 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.753277 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.753343 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:51.755764 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:35535: BlockingRecv error: recv got EOF from 127.12.175.193:35535 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":73,"threads_started":1}
Aug 12 11:21:51 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:51 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:51.930755 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:51.925462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:49289)
0812 11:21:51.925722 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:51.925735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:51.925841 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:51.926053 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:51.926055 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:51.926226 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:51.926322 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:51.926327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.926997 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.926999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:51.927617 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:51.927626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.928082 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.928086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:51.928189 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:51.928809 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:51.928824 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:51.930584 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":100,"threads_started":1}
W20260812 11:21:51.930833 31041 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:51.925502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:49289 (local address 127.12.175.254:33361)
0812 11:21:51.925676 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:51.925680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:51.925808 (+ 128us) server_negotiation.cc:407] Connection header received
0812 11:21:51.925912 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:51.925914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:51.925958 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:51.926022 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:51.926404 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.926917 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.927722 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:51.927962 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:51.928066 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:51.930734 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:49289: BlockingRecv error: recv got EOF from 127.12.175.194:49289 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 12 11:21:52 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:52 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.195@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:52.126744 31043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:52.121480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.195:52285)
0812 11:21:52.121766 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:52.121779 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:52.121912 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:52.122177 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:52.122180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:52.122380 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:52.122485 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:52.122492 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.123234 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.123238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:52.123839 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:52.123848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.124283 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.124287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:52.124370 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:52.124846 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:52.124858 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:52.126588 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":87,"threads_started":1}
W20260812 11:21:52.126829 31041 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:52.121564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:52285 (local address 127.12.175.254:33361)
0812 11:21:52.121710 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:52.121715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:52.121859 (+ 144us) server_negotiation.cc:407] Connection header received
0812 11:21:52.122020 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:52.122023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:52.122073 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:52.122139 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:52.122598 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.123130 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.123957 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.124183 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.124267 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:52.126726 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.195:52285: BlockingRecv error: recv got EOF from 127.12.175.195:52285 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 11:21:52 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:52 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.193@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:52.761423 31045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:52.756515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.193:33995)
0812 11:21:52.756807 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:52.756821 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:52.756916 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:52.757135 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:52.757137 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:52.757314 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:52.757411 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:52.757416 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.758097 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.758098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:52.758645 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:52.758651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.759003 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.759005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:52.759067 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:52.759559 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:52.759572 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:52.761296 (+ 1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":88,"threads_started":1}
W20260812 11:21:52.761564 31047 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:52.756598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:33995 (local address 127.12.175.254:33361)
0812 11:21:52.756820 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:52.756824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:52.756884 (+ 60us) server_negotiation.cc:407] Connection header received
0812 11:21:52.756984 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:52.756986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:52.757027 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:52.757111 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:52.757493 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.758014 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.758721 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.758931 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.758995 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:52.761425 (+ 2430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.193:33995: BlockingRecv error: recv got EOF from 127.12.175.193:33995 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":59,"threads_started":1}
Aug 12 11:21:52 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:21:52 dist-test-slave-gjrz krb5kdc[28810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.175.194@KRBTEST.COM for oryx/127.12.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:21:52.936540 31048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:52.931730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33361 (local address 127.12.175.194:54357)
0812 11:21:52.931986 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:52.931998 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:52.932103 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:52.932303 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:52.932305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:52.932481 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:52.932578 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:52.932584 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.933253 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.933255 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:52.933807 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:52.933814 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.934170 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.934172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:52.934230 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:52.934654 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:52.934665 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:52.936425 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.175.254:33361: Server oryx/127.12.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":82,"threads_started":1}
W20260812 11:21:52.936669 31047 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:52.931782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:54357 (local address 127.12.175.254:33361)
0812 11:21:52.931915 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:52.931920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:52.932066 (+ 146us) server_negotiation.cc:407] Connection header received
0812 11:21:52.932167 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:52.932169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:52.932215 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:52.932276 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:52.932659 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.933175 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.933883 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:52.934095 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:52.934160 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:52.936563 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.175.194:54357: BlockingRecv error: recv got EOF from 127.12.175.194:54357 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:53.019713 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 30098
I20260812 11:21:53.036616 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 30399
I20260812 11:21:53.046546 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 30669
I20260812 11:21:53.066080 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 29942
2026-08-12T11:21:53Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18055 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T11:21:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:53Z Disabled control of system clock
I20260812 11:21:53.098783 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:37335
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:37335
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:21:53.206564 31056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:53.206789 31056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:53.206820 31056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:53.210681 31056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:53.210727 31056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:53.210742 31056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:53.210757 31056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:53.210772 31056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:53.215372 31056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:37335
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:37335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:53.216276 31056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:53.217509 31056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:53.225319 31071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:53.225317 31074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:53.225328 31070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:53.225576 31056 server_base.cc:1034] running on GCE node
I20260812 11:21:53.226218 31056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:53.227198 31056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:53.228351 31056 hybrid_clock.cc:648] HybridClock initialized: now 1786533713228331 us; error 35 us; skew 500 ppm
I20260812 11:21:53.230249 31056 webserver.cc:460] Webserver started at http://127.12.175.254:41197/ using document root <none> and password file <none>
I20260812 11:21:53.230808 31056 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:53.230868 31056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:53.231029 31056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:53.232939 31056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "dde4be4e806f42c1b53412cbe05fcdf3"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "f380d58328f50ec9e67fac9eb2b60422"
server_key_iv: "50edbf330b13058ea1d2e761047f4211"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.233426 31056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "dde4be4e806f42c1b53412cbe05fcdf3"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "f380d58328f50ec9e67fac9eb2b60422"
server_key_iv: "50edbf330b13058ea1d2e761047f4211"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.236737 31056 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:53.238842 31084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.239991 31056 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:53.240099 31056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "dde4be4e806f42c1b53412cbe05fcdf3"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "f380d58328f50ec9e67fac9eb2b60422"
server_key_iv: "50edbf330b13058ea1d2e761047f4211"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.240187 31056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:53.254793 31056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:53.255439 31056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:53.255602 31056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:53.261698 31056 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:37335
I20260812 11:21:53.261737 31176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:37335 every 8 connection(s)
I20260812 11:21:53.262547 31056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:53.263901 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 31056
I20260812 11:21:53.264026 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:53.264286 12991 external_mini_cluster.cc:1428] Setting key d9aaffa902df24e3cc5586b4989c2e08
I20260812 11:21:53.265781 31177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:53.271543 31177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3: Bootstrap starting.
I20260812 11:21:53.272967 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.265616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54792 (local address 127.12.175.254:37335)
0812 11:21:53.266232 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:53.266248 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:53.266281 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:21:53.266896 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:53.266912 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:53.267316 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:53.267589 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:53.267912 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.268850 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.269999 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.270443 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.270551 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.271390 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:53.271395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:53.271407 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:53.271788 (+ 381us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:53.271842 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:53.271864 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:53.271936 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:53.272085 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:21:53.272330 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":110,"threads_started":1}
I20260812 11:21:53.273649 31177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:53.274431 31177 log.cc:824] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:53.276202 31177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3: No bootstrap required, opened a new log
I20260812 11:21:53.279354 31177 raft_consensus.cc:348] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37335 } }
I20260812 11:21:53.279556 31177 raft_consensus.cc:374] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:53.279613 31177 raft_consensus.cc:729] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dde4be4e806f42c1b53412cbe05fcdf3, State: Initialized, Role: FOLLOWER
I20260812 11:21:53.279981 31177 consensus_queue.cc:260] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37335 } }
I20260812 11:21:53.280110 31177 raft_consensus.cc:388] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:53.280175 31177 raft_consensus.cc:482] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:53.280270 31177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:53.281049 31177 raft_consensus.cc:504] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37335 } }
I20260812 11:21:53.281358 31177 leader_election.cc:302] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dde4be4e806f42c1b53412cbe05fcdf3; no voters:
I20260812 11:21:53.281625 31177 leader_election.cc:288] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:53.281708 31185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:53.281927 31185 raft_consensus.cc:686] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [term 1 LEADER]: Becoming Leader. State: Replica: dde4be4e806f42c1b53412cbe05fcdf3, State: Running, Role: LEADER
I20260812 11:21:53.282208 31185 consensus_queue.cc:237] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37335 } }
I20260812 11:21:53.282686 31177 sys_catalog.cc:564] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:53.283699 31188 sys_catalog.cc:455] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37335 } } }
I20260812 11:21:53.283825 31188 sys_catalog.cc:458] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:53.284087 31189 sys_catalog.cc:455] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dde4be4e806f42c1b53412cbe05fcdf3. Latest consensus state: current_term: 1 leader_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dde4be4e806f42c1b53412cbe05fcdf3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 37335 } } }
I20260812 11:21:53.284178 31189 sys_catalog.cc:458] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:53.284186 31200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:53.286661 31200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:53.291464 31200 catalog_manager.cc:1347] Generated new cluster ID: cf212d0a19d34812b4e38819977db2ab
I20260812 11:21:53.291524 31200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:53.306988 31200 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:53.307807 31200 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:53.311550 31200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dde4be4e806f42c1b53412cbe05fcdf3: Generated new TSK 0
I20260812 11:21:53.312062 31200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:53.315009 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37335
--builtin_ntp_servers=127.12.175.212:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 11:21:53.422745 31220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:53.422971 31220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:53.423017 31220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:53.426872 31220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:53.426918 31220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:53.426995 31220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:53.431545 31220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:53.432463 31220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:53.433703 31220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:53.442963 31235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:53.442963 31236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:53.442960 31239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:53.443336 31220 server_base.cc:1034] running on GCE node
I20260812 11:21:53.443779 31220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:53.444376 31220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:53.445530 31220 hybrid_clock.cc:648] HybridClock initialized: now 1786533713445507 us; error 28 us; skew 500 ppm
I20260812 11:21:53.447211 31220 webserver.cc:460] Webserver started at http://127.12.175.193:44313/ using document root <none> and password file <none>
I20260812 11:21:53.447777 31220 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:53.447847 31220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:53.448051 31220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:53.449965 31220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "65705d91e1dd4f248b6b9d99774666ab"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "f4ce0c4e447481309e93ef36b9ad09bb"
server_key_iv: "a0f7b26a3c98969dc34fed7f7dabbd05"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.450491 31220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "65705d91e1dd4f248b6b9d99774666ab"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "f4ce0c4e447481309e93ef36b9ad09bb"
server_key_iv: "a0f7b26a3c98969dc34fed7f7dabbd05"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.453895 31220 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.005s
I20260812 11:21:53.456164 31253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.457252 31220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:53.457362 31220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "65705d91e1dd4f248b6b9d99774666ab"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "f4ce0c4e447481309e93ef36b9ad09bb"
server_key_iv: "a0f7b26a3c98969dc34fed7f7dabbd05"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.457454 31220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:53.513728 31220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:53.514387 31220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:53.514550 31220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:53.515111 31220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:53.516048 31220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:53.516099 31220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.516152 31220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:53.516178 31220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.524180 31220 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:33449
I20260812 11:21:53.524209 31453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:33449 every 8 connection(s)
I20260812 11:21:53.524994 31220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:53.531889 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 31220
I20260812 11:21:53.531991 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:53.532307 12991 external_mini_cluster.cc:1428] Setting key dee426646e5eab1ab4b9c51c93872391
I20260812 11:21:53.533519 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.526651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:58961 (local address 127.12.175.254:37335)
0812 11:21:53.526790 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:53.526794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:53.527824 (+ 1030us) server_negotiation.cc:407] Connection header received
0812 11:21:53.529147 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:53.529150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:53.529201 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:53.529275 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:53.530105 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.530631 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.531695 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.531916 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.532012 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.533086 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:53.533090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:53.533092 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:53.533106 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:53.533129 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:53.533139 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:53.533211 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:53.533321 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 11:21:53.533382 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:21:53.534399 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37335
--builtin_ntp_servers=127.12.175.212:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:21:53.534425 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.527049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:37335 (local address 127.12.175.193:58961)
0812 11:21:53.527681 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:53.527718 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:53.528948 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:53.529417 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:53.529423 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:53.529501 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:53.529964 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:53.529977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.530720 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.530722 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:53.531588 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:53.531598 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.532064 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.532068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:53.532258 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.532811 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:53.532813 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:53.532863 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:53.532938 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:53.533212 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:53.533217 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:53.533222 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:21:53.533305 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 11:21:53.533516 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":135,"threads_started":1}
I20260812 11:21:53.535614 31456 heartbeater.cc:347] Connected to a master server at 127.12.175.254:37335
I20260812 11:21:53.535835 31456 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:53.536347 31456 heartbeater.cc:511] Master 127.12.175.254:37335 requested a full tablet report, sending...
I20260812 11:21:53.537847 31101 ts_manager.cc:194] Registered new tserver with Master: 65705d91e1dd4f248b6b9d99774666ab (127.12.175.193:33449)
I20260812 11:21:53.539359 31101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.193:58961
W20260812 11:21:53.640239 31461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:53.640439 31461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:53.640470 31461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:53.644304 31461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:53.644343 31461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:53.644392 31461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:53.648859 31461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:53.649633 31461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:53.650746 31461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:53.659288 31470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:53.659235 31479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:53.659372 31461 server_base.cc:1034] running on GCE node
W20260812 11:21:53.659253 31474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:53.659855 31461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:53.660377 31461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:53.661530 31461 hybrid_clock.cc:648] HybridClock initialized: now 1786533713661517 us; error 22 us; skew 500 ppm
I20260812 11:21:53.663141 31461 webserver.cc:460] Webserver started at http://127.12.175.194:45315/ using document root <none> and password file <none>
I20260812 11:21:53.663673 31461 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:53.663739 31461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:53.663913 31461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:53.665733 31461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "8e1e7f0da3bb410fa7c086fe758127d6"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "7b437ef80760e50a70a1e32bdba88c30"
server_key_iv: "55b4ed2bc08599936acf3097c47a2ec5"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.666244 31461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "8e1e7f0da3bb410fa7c086fe758127d6"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "7b437ef80760e50a70a1e32bdba88c30"
server_key_iv: "55b4ed2bc08599936acf3097c47a2ec5"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.669546 31461 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 11:21:53.671736 31496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.672788 31461 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:53.672891 31461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "8e1e7f0da3bb410fa7c086fe758127d6"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "7b437ef80760e50a70a1e32bdba88c30"
server_key_iv: "55b4ed2bc08599936acf3097c47a2ec5"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.672981 31461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:53.685245 31461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:53.685788 31461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:53.685937 31461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:53.686421 31461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:53.687288 31461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:53.687341 31461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.687390 31461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:53.687417 31461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.695344 31461 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:46323
I20260812 11:21:53.695381 31704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:46323 every 8 connection(s)
I20260812 11:21:53.696110 31461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:53.701045 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 31461
I20260812 11:21:53.701144 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:53.701392 12991 external_mini_cluster.cc:1428] Setting key 516954d22d4acf205a8bc901f182a61a
I20260812 11:21:53.703246 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37335
--builtin_ntp_servers=127.12.175.212:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:21:53.704561 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.697657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:50377 (local address 127.12.175.254:37335)
0812 11:21:53.697790 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:53.697793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:53.698697 (+ 904us) server_negotiation.cc:407] Connection header received
0812 11:21:53.699973 (+ 1276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:53.699977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:53.700033 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:53.700119 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:53.700926 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.701517 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.702636 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.702882 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.702962 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.704161 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:53.704164 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:53.704166 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:53.704177 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:53.704196 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:53.704204 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:53.704260 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:53.704398 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:21:53.704446 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:21:53.705417 31709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.697971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:37335 (local address 127.12.175.194:50377)
0812 11:21:53.698565 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:53.698600 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:53.699780 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:53.700278 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:53.700284 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:53.700359 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:53.700784 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:53.700796 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.701647 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.701651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:53.702521 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:53.702531 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.703025 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.703030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:53.703240 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.703893 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:53.703895 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:53.703944 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:53.704017 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:53.704276 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:53.704284 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:53.704289 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:21:53.704392 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:21:53.704649 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":111,"threads_started":1}
I20260812 11:21:53.706475 31706 heartbeater.cc:347] Connected to a master server at 127.12.175.254:37335
I20260812 11:21:53.706671 31706 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:53.707095 31706 heartbeater.cc:511] Master 127.12.175.254:37335 requested a full tablet report, sending...
I20260812 11:21:53.708068 31101 ts_manager.cc:194] Registered new tserver with Master: 8e1e7f0da3bb410fa7c086fe758127d6 (127.12.175.194:46323)
I20260812 11:21:53.708596 31101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.194:50377
W20260812 11:21:53.809803 31712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:53.810024 31712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:53.810081 31712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:53.813925 31712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:53.813970 31712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:53.814038 31712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:53.818513 31712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:37335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:53.819406 31712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:53.820591 31712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:53.829301 31723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:53.829360 31712 server_base.cc:1034] running on GCE node
W20260812 11:21:53.829324 31720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:53.829312 31727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:53.829847 31712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:53.830389 31712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:53.831535 31712 hybrid_clock.cc:648] HybridClock initialized: now 1786533713831524 us; error 26 us; skew 500 ppm
I20260812 11:21:53.833141 31712 webserver.cc:460] Webserver started at http://127.12.175.195:40941/ using document root <none> and password file <none>
I20260812 11:21:53.833642 31712 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:53.833704 31712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:53.833892 31712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:53.835783 31712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "b435fcc665c84f1682fceba377d842a3"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "2c29c0b81481aa7b641a4112528cb0cd"
server_key_iv: "8e1e65d359e60f0dc88799093bcf87b7"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.836287 31712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "b435fcc665c84f1682fceba377d842a3"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "2c29c0b81481aa7b641a4112528cb0cd"
server_key_iv: "8e1e65d359e60f0dc88799093bcf87b7"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.839602 31712 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:53.841789 31747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.842880 31712 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:53.842986 31712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "b435fcc665c84f1682fceba377d842a3"
format_stamp: "Formatted at 2026-08-12 11:21:53 on dist-test-slave-gjrz"
server_key: "2c29c0b81481aa7b641a4112528cb0cd"
server_key_iv: "8e1e65d359e60f0dc88799093bcf87b7"
server_key_version: "encryptionkey@0"
I20260812 11:21:53.843086 31712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:53.854740 31712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:53.855305 31712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:53.855454 31712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:53.855937 31712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:53.856755 31712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:53.856802 31712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.856850 31712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:53.856879 31712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:53.864976 31712 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:33079
I20260812 11:21:53.864997 31962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:33079 every 8 connection(s)
I20260812 11:21:53.865737 31712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:53.869818 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 31712
I20260812 11:21:53.869930 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:53.870218 12991 external_mini_cluster.cc:1428] Setting key 0603ea923eab80514e306b3878a69ae7
I20260812 11:21:53.874387 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.867313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:51391 (local address 127.12.175.254:37335)
0812 11:21:53.867465 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:53.867470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:53.868451 (+ 981us) server_negotiation.cc:407] Connection header received
0812 11:21:53.869719 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:53.869722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:53.869768 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:53.869838 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:53.870904 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.871635 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.872886 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.873108 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.873183 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.874028 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:53.874032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:53.874033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:53.874054 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:53.874073 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:53.874081 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:53.874132 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:53.874234 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 11:21:53.874282 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:21:53.875113 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.867681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:37335 (local address 127.12.175.195:51391)
0812 11:21:53.868313 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:53.868349 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:53.869524 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:53.870031 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:53.870049 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:53.870154 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:53.870734 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:53.870752 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.871755 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.871759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:53.872779 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:53.872790 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:53.873216 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:53.873219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:53.873349 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:53.873809 (+ 460us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:53.873811 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:53.873846 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:53.873904 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:53.874140 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:53.874144 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:53.874148 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:21:53.874227 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 11:21:53.874425 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":130,"threads_started":1}
I20260812 11:21:53.876056 31963 heartbeater.cc:347] Connected to a master server at 127.12.175.254:37335
I20260812 11:21:53.876255 31963 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:53.876731 31963 heartbeater.cc:511] Master 127.12.175.254:37335 requested a full tablet report, sending...
I20260812 11:21:53.877640 31101 ts_manager.cc:194] Registered new tserver with Master: b435fcc665c84f1682fceba377d842a3 (127.12.175.195:33079)
I20260812 11:21:53.878147 31101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.195:51391
I20260812 11:21:53.883626 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:21:53.886121 31180 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:53.885382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54800 (local address 127.12.175.254:37335)
0812 11:21:53.885506 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:53.885510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:53.885633 (+ 123us) server_negotiation.cc:407] Connection header received
0812 11:21:53.885718 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:53.885719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:53.885756 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:53.885812 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:53.885978 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54800: BlockingRecv error: recv got EOF from 127.0.0.1:54800 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:21:53.886246 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 31220
I20260812 11:21:53.919646 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 31461
I20260812 11:21:53.926256 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 31712
I20260812 11:21:53.945818 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 31056
2026-08-12T11:21:53Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (881 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T11:21:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:53Z Disabled control of system clock
I20260812 11:21:53.980252 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45031
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:34609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:45031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:21:54.084184 31984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:54.084393 31984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:54.084425 31984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:54.088217 31984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:54.088258 31984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:54.088271 31984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:54.088289 31984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:54.088306 31984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:54.092710 31984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:45031
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:54.093503 31984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:54.094643 31984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:54.102281 32005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:54.102332 31984 server_base.cc:1034] running on GCE node
W20260812 11:21:54.102312 32000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:54.102288 32002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:54.102989 31984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:54.104043 31984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:54.105209 31984 hybrid_clock.cc:648] HybridClock initialized: now 1786533714105194 us; error 26 us; skew 500 ppm
I20260812 11:21:54.106829 31984 webserver.cc:460] Webserver started at http://127.12.175.254:44623/ using document root <none> and password file <none>
I20260812 11:21:54.107372 31984 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:54.107443 31984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:54.107648 31984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:54.109503 31984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "4eb0c9454db94ed0ada2a890580b5a98"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "07137700255ada721ba23877a11045c7"
server_key_iv: "d78d8bb9d4d6ce6cdbd3f05d1fb2e405"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.110064 31984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "4eb0c9454db94ed0ada2a890580b5a98"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "07137700255ada721ba23877a11045c7"
server_key_iv: "d78d8bb9d4d6ce6cdbd3f05d1fb2e405"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.113459 31984 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 11:21:54.115731 32013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.116838 31984 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:54.116950 31984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "4eb0c9454db94ed0ada2a890580b5a98"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "07137700255ada721ba23877a11045c7"
server_key_iv: "d78d8bb9d4d6ce6cdbd3f05d1fb2e405"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.117041 31984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:54.121286 31984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:54.121825 31984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:54.121985 31984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:54.128113 31984 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:45031
I20260812 11:21:54.128118 32116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:45031 every 8 connection(s)
I20260812 11:21:54.128985 31984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:54.131899 32118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:54.134805 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 31984
I20260812 11:21:54.134922 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:54.135215 12991 external_mini_cluster.cc:1428] Setting key 2d395d2a0f70f0583188125d8b3a6fed
I20260812 11:21:54.137313 32118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98: Bootstrap starting.
I20260812 11:21:54.139533 32118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:54.140230 32118 log.cc:824] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:54.140275 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.136499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35916 (local address 127.12.175.254:45031)
0812 11:21:54.137052 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:54.137068 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:54.137101 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:21:54.137732 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:54.137751 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:54.138078 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:54.138336 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:54.139099 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:54.139104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:54.139114 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:54.139126 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:54.139178 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:54.139193 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:54.139310 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:54.139419 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 11:21:54.139665 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":97,"threads_started":1}
I20260812 11:21:54.142022 32118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98: No bootstrap required, opened a new log
I20260812 11:21:54.145231 32118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb0c9454db94ed0ada2a890580b5a98" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45031 } }
I20260812 11:21:54.145417 32118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:54.145464 32118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eb0c9454db94ed0ada2a890580b5a98, State: Initialized, Role: FOLLOWER
I20260812 11:21:54.145840 32118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb0c9454db94ed0ada2a890580b5a98" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45031 } }
I20260812 11:21:54.145962 32118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:54.146020 32118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:54.146116 32118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:54.146842 32118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb0c9454db94ed0ada2a890580b5a98" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45031 } }
I20260812 11:21:54.147140 32118 leader_election.cc:302] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4eb0c9454db94ed0ada2a890580b5a98; no voters:
I20260812 11:21:54.147408 32118 leader_election.cc:288] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:54.147508 32127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:54.147742 32127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [term 1 LEADER]: Becoming Leader. State: Replica: 4eb0c9454db94ed0ada2a890580b5a98, State: Running, Role: LEADER
I20260812 11:21:54.148095 32127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb0c9454db94ed0ada2a890580b5a98" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45031 } }
I20260812 11:21:54.148492 32118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:54.149637 32129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4eb0c9454db94ed0ada2a890580b5a98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb0c9454db94ed0ada2a890580b5a98" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45031 } } }
I20260812 11:21:54.149778 32129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:54.149637 32128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4eb0c9454db94ed0ada2a890580b5a98. Latest consensus state: current_term: 1 leader_uuid: "4eb0c9454db94ed0ada2a890580b5a98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb0c9454db94ed0ada2a890580b5a98" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45031 } } }
I20260812 11:21:54.149843 32128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:54.150204 32140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:54.153059 32140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:54.157625 32140 catalog_manager.cc:1347] Generated new cluster ID: c5550844b372493eabcd88dfdddbbcb0
I20260812 11:21:54.157689 32140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:54.172326 32140 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:54.172577 32140 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:54.182060 32140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4eb0c9454db94ed0ada2a890580b5a98: Generated new TSK 0
I20260812 11:21:54.182596 32140 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:21:54.185436 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45031
--builtin_ntp_servers=127.12.175.212:34609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:21:54.292641 32157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:54.292860 32157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:54.292899 32157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:54.296794 32157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:54.296837 32157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:54.296901 32157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:54.301599 32157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:54.302502 32157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:54.303769 32157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:54.312561 32169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:54.312546 32167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:54.312547 32166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:54.312594 32157 server_base.cc:1034] running on GCE node
I20260812 11:21:54.313124 32157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:54.313685 32157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:54.314851 32157 hybrid_clock.cc:648] HybridClock initialized: now 1786533714314832 us; error 29 us; skew 500 ppm
I20260812 11:21:54.316458 32157 webserver.cc:460] Webserver started at http://127.12.175.193:36099/ using document root <none> and password file <none>
I20260812 11:21:54.316931 32157 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:54.316984 32157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:54.317138 32157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:54.318905 32157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "a76ef9e021b94642965e2182299b8fbb"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "028b84407af3b1bb47233fcac2c9c8e6"
server_key_iv: "6c38023db5791e23f03cb8672c27d9e0"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.319417 32157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "a76ef9e021b94642965e2182299b8fbb"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "028b84407af3b1bb47233fcac2c9c8e6"
server_key_iv: "6c38023db5791e23f03cb8672c27d9e0"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.322813 32157 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:54.325034 32185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.326143 32157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:54.326254 32157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "a76ef9e021b94642965e2182299b8fbb"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "028b84407af3b1bb47233fcac2c9c8e6"
server_key_iv: "6c38023db5791e23f03cb8672c27d9e0"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.326349 32157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:54.330533 32157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:54.331070 32157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:54.331225 32157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:54.331732 32157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:54.332551 32157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:54.332597 32157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.332645 32157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:54.332674 32157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.340557 32157 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:44855
I20260812 11:21:54.340610 32401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:44855 every 8 connection(s)
I20260812 11:21:54.341310 32157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:54.341568 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 32157
I20260812 11:21:54.341686 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:54.342061 12991 external_mini_cluster.cc:1428] Setting key 28a1ae6a50d99b916d0915e0e8e3e2cc
I20260812 11:21:54.344125 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45031
--builtin_ntp_servers=127.12.175.212:34609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:21:54.347291 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.343005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:52811 (local address 127.12.175.254:45031)
0812 11:21:54.343133 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:54.343137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:54.344368 (+ 1231us) server_negotiation.cc:407] Connection header received
0812 11:21:54.345643 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:54.345646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:54.345691 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:54.345762 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:54.346815 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:54.346819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:54.346822 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:54.346834 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:54.346854 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:54.346862 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:54.346936 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:54.347095 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 11:21:54.347141 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:54.348006 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.343409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45031 (local address 127.12.175.193:52811)
0812 11:21:54.344204 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:54.344260 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:54.345423 (+ 1163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:54.345941 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:54.345948 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:54.346029 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:54.346552 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:54.346554 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:54.346590 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:54.346654 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:54.346934 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:54.346942 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:54.346948 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:21:54.347125 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 11:21:54.347362 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":128,"threads_started":1}
I20260812 11:21:54.349153 32403 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45031
I20260812 11:21:54.349375 32403 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:54.349746 32403 heartbeater.cc:511] Master 127.12.175.254:45031 requested a full tablet report, sending...
I20260812 11:21:54.351135 32043 ts_manager.cc:194] Registered new tserver with Master: a76ef9e021b94642965e2182299b8fbb (127.12.175.193:44855)
W20260812 11:21:54.451170 32407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:54.451435 32407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:54.451493 32407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:54.455349 32407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:54.455392 32407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:54.455466 32407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:54.460041 32407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:54.460932 32407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:54.462517 32407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:54.471648 32419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:54.471692 32421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:54.471649 32417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:54.471807 32407 server_base.cc:1034] running on GCE node
I20260812 11:21:54.472187 32407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:54.472759 32407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:54.473904 32407 hybrid_clock.cc:648] HybridClock initialized: now 1786533714473896 us; error 43 us; skew 500 ppm
I20260812 11:21:54.475525 32407 webserver.cc:460] Webserver started at http://127.12.175.194:33793/ using document root <none> and password file <none>
I20260812 11:21:54.476027 32407 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:54.476087 32407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:54.476269 32407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:54.478094 32407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "3a165fd801614e80908679088927773c"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "e2481d976b67a847c16f6df60817a4cf"
server_key_iv: "1bf0baaba93e02e80fc31dedb16b0f3f"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.478600 32407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "3a165fd801614e80908679088927773c"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "e2481d976b67a847c16f6df60817a4cf"
server_key_iv: "1bf0baaba93e02e80fc31dedb16b0f3f"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.481911 32407 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:21:54.484161 32431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.485198 32407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:21:54.485288 32407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "3a165fd801614e80908679088927773c"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "e2481d976b67a847c16f6df60817a4cf"
server_key_iv: "1bf0baaba93e02e80fc31dedb16b0f3f"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.485383 32407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:54.489524 32407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:54.490039 32407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:54.490180 32407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:54.490676 32407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:54.491524 32407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:54.491578 32407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.491617 32407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:54.491647 32407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.499112 32407 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:45841
I20260812 11:21:54.499164 32653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:45841 every 8 connection(s)
I20260812 11:21:54.499874 32407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:54.500191 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 32407
I20260812 11:21:54.500322 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:54.500613 12991 external_mini_cluster.cc:1428] Setting key c86237bd414d826deb4547dc223d8ee5
I20260812 11:21:54.502653 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45031
--builtin_ntp_servers=127.12.175.212:34609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:21:54.505980 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.501518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:52781 (local address 127.12.175.254:45031)
0812 11:21:54.501635 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:54.501639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:54.502893 (+ 1254us) server_negotiation.cc:407] Connection header received
0812 11:21:54.504447 (+ 1554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:54.504451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:54.504493 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:54.504587 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:54.505547 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:54.505551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:54.505553 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:54.505566 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:54.505589 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:54.505600 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:54.505684 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:54.505812 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 11:21:54.505854 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:21:54.506698 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.501998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45031 (local address 127.12.175.194:52781)
0812 11:21:54.502757 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:54.502813 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:54.504200 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:54.504730 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:54.504736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:54.504817 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:54.505301 (+ 484us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:54.505303 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:54.505339 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:54.505402 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:54.505679 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:54.505688 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:54.505695 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:21:54.505845 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:21:54.506074 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":112,"threads_started":1}
I20260812 11:21:54.507668 32656 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45031
I20260812 11:21:54.507907 32656 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:54.508342 32656 heartbeater.cc:511] Master 127.12.175.254:45031 requested a full tablet report, sending...
I20260812 11:21:54.509435 32043 ts_manager.cc:194] Registered new tserver with Master: 3a165fd801614e80908679088927773c (127.12.175.194:45841)
W20260812 11:21:54.608999 32659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:54.609208 32659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:54.609243 32659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:54.613377 32659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:54.613421 32659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:54.613480 32659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:54.617996 32659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:45031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:54.618853 32659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:54.620069 32659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:54.628773 32672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:54.628831 32671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:54.628854 32659 server_base.cc:1034] running on GCE node
W20260812 11:21:54.628975 32676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:54.629359 32659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:54.629925 32659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:54.631101 32659 hybrid_clock.cc:648] HybridClock initialized: now 1786533714631080 us; error 39 us; skew 500 ppm
I20260812 11:21:54.632673 32659 webserver.cc:460] Webserver started at http://127.12.175.195:41189/ using document root <none> and password file <none>
I20260812 11:21:54.633198 32659 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:54.633265 32659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:54.633440 32659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:54.635214 32659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "b9e850441d9c4be5a3d06c1b82cd4c2a"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "c03a28cd1867fbc68773e0ff7f61088f"
server_key_iv: "be1bb69373d9531f7afab141cb46fefa"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.635900 32659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "b9e850441d9c4be5a3d06c1b82cd4c2a"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "c03a28cd1867fbc68773e0ff7f61088f"
server_key_iv: "be1bb69373d9531f7afab141cb46fefa"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.639108 32659 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:54.641301 32686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.642349 32659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:54.642449 32659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "b9e850441d9c4be5a3d06c1b82cd4c2a"
format_stamp: "Formatted at 2026-08-12 11:21:54 on dist-test-slave-gjrz"
server_key: "c03a28cd1867fbc68773e0ff7f61088f"
server_key_iv: "be1bb69373d9531f7afab141cb46fefa"
server_key_version: "encryptionkey@0"
I20260812 11:21:54.642545 32659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:54.646633 32659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:54.647143 32659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:54.647325 32659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:54.647809 32659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:54.648597 32659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:54.648643 32659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.648689 32659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:54.648744 32659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:54.656774 32659 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:45821
I20260812 11:21:54.656827 430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:45821 every 8 connection(s)
I20260812 11:21:54.657526 32659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:54.658954 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 32659
I20260812 11:21:54.659070 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:54.659392 12991 external_mini_cluster.cc:1428] Setting key ea1002e7324dd1ecad59cad5554b22a5
I20260812 11:21:54.662990 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.659075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40997 (local address 127.12.175.254:45031)
0812 11:21:54.659210 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:54.659215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:54.660288 (+ 1073us) server_negotiation.cc:407] Connection header received
0812 11:21:54.661482 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:54.661485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:54.661530 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:54.661605 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:54.662579 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:54.662582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:54.662585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:21:54.662598 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:54.662620 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:21:54.662628 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:54.662699 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:54.662823 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 11:21:54.662867 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:21:54.663818 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.659507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45031 (local address 127.12.175.195:40997)
0812 11:21:54.660153 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:54.660189 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:54.661288 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:54.661758 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:54.661764 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:54.661843 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:54.662337 (+ 494us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:21:54.662338 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:54.662376 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:21:54.662440 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:54.662695 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:54.662704 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:54.662710 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:21:54.662855 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:21:54.663071 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":133,"threads_started":1}
I20260812 11:21:54.664765 431 heartbeater.cc:347] Connected to a master server at 127.12.175.254:45031
I20260812 11:21:54.664942 431 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:54.665258 431 heartbeater.cc:511] Master 127.12.175.254:45031 requested a full tablet report, sending...
I20260812 11:21:54.666121 32043 ts_manager.cc:194] Registered new tserver with Master: b9e850441d9c4be5a3d06c1b82cd4c2a (127.12.175.195:45821)
I20260812 11:21:54.672744 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:21:54.675410 32121 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:21:54.674669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35928 (local address 127.12.175.254:45031)
0812 11:21:54.674830 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:54.674834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:54.674913 (+ 79us) server_negotiation.cc:407] Connection header received
0812 11:21:54.675007 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:54.675009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:54.675035 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:54.675102 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:54.675298 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35928: BlockingRecv error: recv got EOF from 127.0.0.1:35928 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:21:54.675531 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 32157
I20260812 11:21:54.728751 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 32407
I20260812 11:21:54.742571 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 32659
I20260812 11:21:54.751596 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 31984
2026-08-12T11:21:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (802 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:54 dist-test-slave-gjrz krb5kdc[451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:54 dist-test-slave-gjrz krb5kdc[451](info): set up 2 sockets
Aug 12 11:21:54 dist-test-slave-gjrz krb5kdc[451](info): commencing operation
krb5kdc: starting...
W20260812 11:21:55.948730 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:21:56.059810 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42249
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:42249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:56.164832 467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:56.165064 467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:56.165117 467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:56.168973 467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:56.169018 467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:56.169044 467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:56.169063 467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:56.169085 467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:56.174237 467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:42249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:56.175143 467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:56.176074 467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:56.183908 475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.183911 478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.183982 473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:56.184000 467 server_base.cc:1034] running on GCE node
I20260812 11:21:56.184689 467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:56.185681 467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:56.186861 467 hybrid_clock.cc:648] HybridClock initialized: now 1786533716186842 us; error 27 us; skew 500 ppm
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:56.195039 467 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:21:56.195886 467 webserver.cc:460] Webserver started at http://127.12.175.254:36655/ using document root <none> and password file <none>
I20260812 11:21:56.196393 467 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:56.196460 467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:56.196621 467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:56.198519 467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "52631dca993c4dce9aec3c37d7901978"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "24081f3d6a32ba9152a1f930bb52b229"
server_key_iv: "67c3055f1299297f16289bf4d0a6705a"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.199010 467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "52631dca993c4dce9aec3c37d7901978"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "24081f3d6a32ba9152a1f930bb52b229"
server_key_iv: "67c3055f1299297f16289bf4d0a6705a"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.202456 467 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:21:56.204654 495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.205762 467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:21:56.205873 467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "52631dca993c4dce9aec3c37d7901978"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "24081f3d6a32ba9152a1f930bb52b229"
server_key_iv: "67c3055f1299297f16289bf4d0a6705a"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.205960 467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:56.221194 467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:56.223994 467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:56.224152 467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:56.230696 594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:42249 every 8 connection(s)
I20260812 11:21:56.230719 467 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:42249
I20260812 11:21:56.231608 467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:56.234148 595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:56.234714 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 467
I20260812 11:21:56.234838 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:21:56.235147 12991 external_mini_cluster.cc:1428] Setting key 0e223517401890bb788bd31a91789803
I20260812 11:21:56.241117 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978: Bootstrap starting.
I20260812 11:21:56.243444 595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978: Neither blocks nor log segments found. Creating new log.
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:56.244120 595 log.cc:824] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:56.246209 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978: No bootstrap required, opened a new log
I20260812 11:21:56.249467 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.236394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.12.175.254:42249)
0812 11:21:56.236852 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.236872 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.236913 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:21:56.237669 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.237693 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.238096 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.238435 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:56.239086 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.240564 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.241521 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.242205 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.242355 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.244708 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:56.244713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:56.244726 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:56.244751 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:56.246532 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.246979 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.246984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.246990 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.247127 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.247384 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.247387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.247389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.247878 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:56.248084 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.248310 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.248610 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":119,"threads_started":1}
I20260812 11:21:56.250394 595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52631dca993c4dce9aec3c37d7901978" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42249 } }
I20260812 11:21:56.250661 595 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:56.250717 595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52631dca993c4dce9aec3c37d7901978, State: Initialized, Role: FOLLOWER
I20260812 11:21:56.251130 595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52631dca993c4dce9aec3c37d7901978" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42249 } }
I20260812 11:21:56.251257 595 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:56.251341 595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:56.251433 595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:56.252305 595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52631dca993c4dce9aec3c37d7901978" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42249 } }
I20260812 11:21:56.252605 595 leader_election.cc:302] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52631dca993c4dce9aec3c37d7901978; no voters:
I20260812 11:21:56.252871 595 leader_election.cc:288] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:21:56.252990 605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:56.253163 605 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [term 1 LEADER]: Becoming Leader. State: Replica: 52631dca993c4dce9aec3c37d7901978, State: Running, Role: LEADER
I20260812 11:21:56.253504 605 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52631dca993c4dce9aec3c37d7901978" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42249 } }
I20260812 11:21:56.253959 595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:56.254993 606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52631dca993c4dce9aec3c37d7901978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52631dca993c4dce9aec3c37d7901978" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42249 } } }
I20260812 11:21:56.255110 606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:56.255501 620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:56.256501 607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52631dca993c4dce9aec3c37d7901978. Latest consensus state: current_term: 1 leader_uuid: "52631dca993c4dce9aec3c37d7901978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52631dca993c4dce9aec3c37d7901978" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42249 } } }
I20260812 11:21:56.256604 607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:56.258138 620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:56.263967 620 catalog_manager.cc:1347] Generated new cluster ID: 0b044aedff3a4713a731df0c07875c65
I20260812 11:21:56.264030 620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:56.282680 620 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:21:56.283535 620 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:56.288057 620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978: Generated new TSK 0
I20260812 11:21:56.288749 620 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:21:56.324342 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42249
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:56.430620 652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:56.430843 652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:56.430898 652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:56.434756 652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:56.434806 652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:56.434883 652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:21:56.439790 652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:56.440680 652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:56.441584 652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:56.450271 661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.450279 667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.450279 662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:56.450488 652 server_base.cc:1034] running on GCE node
I20260812 11:21:56.450960 652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:56.451599 652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:56.452759 652 hybrid_clock.cc:648] HybridClock initialized: now 1786533716452743 us; error 26 us; skew 500 ppm
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:56.455335 652 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:21:56.456139 652 webserver.cc:460] Webserver started at http://127.12.175.193:45425/ using document root <none> and password file <none>
I20260812 11:21:56.456662 652 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:56.456729 652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:56.456916 652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:56.458833 652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "047afb8087fb41d3bd93ec2f8ab83f46"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "2aaa628e1227369e822ae9785a0f3af1"
server_key_iv: "d0ec884878c4fec1a8b759053ac06f31"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.459403 652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "047afb8087fb41d3bd93ec2f8ab83f46"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "2aaa628e1227369e822ae9785a0f3af1"
server_key_iv: "d0ec884878c4fec1a8b759053ac06f31"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.462754 652 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:56.464974 683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.466090 652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:56.466197 652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "047afb8087fb41d3bd93ec2f8ab83f46"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "2aaa628e1227369e822ae9785a0f3af1"
server_key_iv: "d0ec884878c4fec1a8b759053ac06f31"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.466284 652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:56.476042 652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:56.478434 652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:56.478596 652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:56.479101 652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:56.479877 652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:56.479925 652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.479974 652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:56.480002 652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.487952 652 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:33737
I20260812 11:21:56.487993 914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:33737 every 8 connection(s)
I20260812 11:21:56.488727 652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:56.489663 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 652
I20260812 11:21:56.489771 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:21:56.490109 12991 external_mini_cluster.cc:1428] Setting key 008048a4380d1cb4a800c352702510db
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:21:56.501924 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.490342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:55535 (local address 127.12.175.254:42249)
0812 11:21:56.490472 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.490476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.491366 (+ 890us) server_negotiation.cc:407] Connection header received
0812 11:21:56.493015 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.493018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.493063 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.493129 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:56.494390 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.494909 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.496050 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.496344 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.496433 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.498957 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:56.498960 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:56.498962 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:56.498985 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:56.500289 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.500718 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.500720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.500722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.500789 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.501079 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.501082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.501083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.501250 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:56.501324 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.501701 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.501794 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
I20260812 11:21:56.502641 920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.490704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42249 (local address 127.12.175.193:55535)
0812 11:21:56.491181 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.491235 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:56.492805 (+ 1570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:56.493296 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:56.493306 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:56.493763 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:56.494248 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.494261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.495027 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.495031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.495934 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.495944 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.496497 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.496502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.496659 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.497167 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:56.497181 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:56.498799 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:56.500394 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:56.500399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:56.500409 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:56.500642 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:56.500850 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:56.500852 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:56.500853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:56.500986 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:56.501324 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:56.501328 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:56.501528 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 11:21:56.501670 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 11:21:56.501900 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":108,"threads_started":1}
I20260812 11:21:56.503731 916 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42249
I20260812 11:21:56.503940 916 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:56.504355 916 heartbeater.cc:511] Master 127.12.175.254:42249 requested a full tablet report, sending...
I20260812 11:21:56.505987 525 ts_manager.cc:194] Registered new tserver with Master: 047afb8087fb41d3bd93ec2f8ab83f46 (127.12.175.193:33737)
I20260812 11:21:56.509706 525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:55535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:21:56.521834 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42249
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:56.639652 924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:56.639858 924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:56.639899 924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:56.643743 924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:56.643790 924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:56.643857 924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:21:56.648716 924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:56.649534 924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:56.650394 924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:56.659773 929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:56.663120 924 server_base.cc:1034] running on GCE node
W20260812 11:21:56.663445 937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.663492 933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:56.663877 924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:56.664554 924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:56.665729 924 hybrid_clock.cc:648] HybridClock initialized: now 1786533716665710 us; error 30 us; skew 500 ppm
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:56.668341 924 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:21:56.669137 924 webserver.cc:460] Webserver started at http://127.12.175.194:37023/ using document root <none> and password file <none>
I20260812 11:21:56.669621 924 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:56.669682 924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:56.669880 924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:56.671783 924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "00d65184c3c84bbeb769b554f5f9337f"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "6715826ab2e2379b787036d95255c119"
server_key_iv: "bbc1ab329bf7dea06a2888f80e320d07"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.672282 924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "00d65184c3c84bbeb769b554f5f9337f"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "6715826ab2e2379b787036d95255c119"
server_key_iv: "bbc1ab329bf7dea06a2888f80e320d07"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.675621 924 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:21:56.677745 946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.678790 924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:21:56.678884 924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "00d65184c3c84bbeb769b554f5f9337f"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "6715826ab2e2379b787036d95255c119"
server_key_iv: "bbc1ab329bf7dea06a2888f80e320d07"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.678969 924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:56.696165 924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:56.698416 924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:56.698565 924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:56.699046 924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:56.699772 924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:56.699816 924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.699853 924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:56.699882 924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.707841 924 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:41417
I20260812 11:21:56.707867 1179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:41417 every 8 connection(s)
I20260812 11:21:56.708573 924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:56.709468 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 924
I20260812 11:21:56.709596 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:21:56.709890 12991 external_mini_cluster.cc:1428] Setting key 4d3fa84098c81db1525a1cf3787feb33
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:21:56.722311 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.710334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:36651 (local address 127.12.175.254:42249)
0812 11:21:56.710454 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.710458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.711290 (+ 832us) server_negotiation.cc:407] Connection header received
0812 11:21:56.712901 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.712904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.712947 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.713027 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:56.714369 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.714891 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.716392 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.716629 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.716719 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.719149 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:56.719154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:56.719156 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:56.719187 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:56.720608 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.721058 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.721062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.721064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.721158 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.721438 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.721440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.721442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.721618 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:56.721691 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.722107 (+ 416us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.722203 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:21:56.722997 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.710650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42249 (local address 127.12.175.194:36651)
0812 11:21:56.711117 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.711170 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:56.712699 (+ 1529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:56.713204 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:56.713211 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:56.713630 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:56.714220 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.714238 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.715000 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.715003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.716267 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.716279 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.716781 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.716785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.716974 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.717457 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:56.717478 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:56.718966 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:56.720716 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:56.720721 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:56.720731 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:56.720965 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:56.721243 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:56.721245 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:56.721247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:56.721368 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:56.721691 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:56.721695 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:56.721924 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 11:21:56.722076 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:21:56.722291 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
I20260812 11:21:56.724110 1180 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42249
I20260812 11:21:56.724309 1180 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:56.724713 1180 heartbeater.cc:511] Master 127.12.175.254:42249 requested a full tablet report, sending...
I20260812 11:21:56.725664 525 ts_manager.cc:194] Registered new tserver with Master: 00d65184c3c84bbeb769b554f5f9337f (127.12.175.194:41417)
I20260812 11:21:56.726218 525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:36651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:21:56.737637 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42249
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:56.842083 1201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:56.842298 1201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:56.842351 1201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:56.846240 1201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:56.846292 1201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:56.846364 1201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:21:56.851348 1201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:21:56.852222 1201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:56.853132 1201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:56.861981 1206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.861991 1214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:56.861977 1212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:56.862015 1201 server_base.cc:1034] running on GCE node
I20260812 11:21:56.862629 1201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:56.863196 1201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:56.864354 1201 hybrid_clock.cc:648] HybridClock initialized: now 1786533716864330 us; error 37 us; skew 500 ppm
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:56.866776 1201 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:21:56.867616 1201 webserver.cc:460] Webserver started at http://127.12.175.195:35319/ using document root <none> and password file <none>
I20260812 11:21:56.868121 1201 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:56.868186 1201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:56.868377 1201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:21:56.870262 1201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "7abab159fa764d25ba21df0933266ec3"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "c8af112615d1b5ba3063c27302b35e7b"
server_key_iv: "6c3c107d46b59b435f6c58ab75c87dbf"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.870803 1201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "7abab159fa764d25ba21df0933266ec3"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "c8af112615d1b5ba3063c27302b35e7b"
server_key_iv: "6c3c107d46b59b435f6c58ab75c87dbf"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.874212 1201 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:21:56.876461 1225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.877545 1201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:21:56.877656 1201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "7abab159fa764d25ba21df0933266ec3"
format_stamp: "Formatted at 2026-08-12 11:21:56 on dist-test-slave-gjrz"
server_key: "c8af112615d1b5ba3063c27302b35e7b"
server_key_iv: "6c3c107d46b59b435f6c58ab75c87dbf"
server_key_version: "encryptionkey@0"
I20260812 11:21:56.877743 1201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:56.899636 1201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:56.901997 1201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:56.902158 1201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:56.902655 1201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:56.903402 1201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:56.903448 1201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.903498 1201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:56.903527 1201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:56.912462 1201 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:46527
I20260812 11:21:56.912494 1460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:46527 every 8 connection(s)
I20260812 11:21:56.913229 1201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
Aug 12 11:21:56 dist-test-slave-gjrz krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:21:56.923012 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 1201
I20260812 11:21:56.923123 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:21:56.923424 12991 external_mini_cluster.cc:1428] Setting key e2853b0c3ffb9f901a49e85928997451
I20260812 11:21:56.925845 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.914789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:53923 (local address 127.12.175.254:42249)
0812 11:21:56.914906 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.914910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.915649 (+ 739us) server_negotiation.cc:407] Connection header received
0812 11:21:56.916940 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.916944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.917001 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.917079 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:56.918132 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.918658 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.919795 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.920021 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.920113 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.922191 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:56.922194 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:56.922196 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:56.922221 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:56.923402 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.923997 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.924000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.924002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.924095 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.924394 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.924397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.924399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.924585 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:56.924671 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.925582 (+ 911us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.925699 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:21:56.926487 1470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.915103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42249 (local address 127.12.175.195:53923)
0812 11:21:56.915516 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.915558 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:56.916742 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:56.917240 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:56.917247 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:56.917562 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:56.917981 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.917995 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.918771 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.918774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.919681 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.919691 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.920155 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.920159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.920321 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.920743 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:56.920758 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:56.922030 (+ 1272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:56.923508 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:56.923514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:56.923527 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:56.923755 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:56.924173 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:56.924177 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:56.924179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:56.924307 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:56.925154 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:56.925159 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:56.925355 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 11:21:56.925510 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 11:21:56.925789 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":122,"threads_started":1}
I20260812 11:21:56.927445 1462 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42249
I20260812 11:21:56.927657 1462 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:56.928072 1462 heartbeater.cc:511] Master 127.12.175.254:42249 requested a full tablet report, sending...
I20260812 11:21:56.928958 525 ts_manager.cc:194] Registered new tserver with Master: 7abab159fa764d25ba21df0933266ec3 (127.12.175.195:46527)
I20260812 11:21:56.929453 525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:53923
I20260812 11:21:56.936604 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:21:56.944249 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.938248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33146 (local address 127.12.175.254:42249)
0812 11:21:56.938357 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.938360 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.938563 (+ 203us) server_negotiation.cc:407] Connection header received
0812 11:21:56.938667 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.938670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.938705 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.938756 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:56.939361 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.939825 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.940561 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.940752 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.940813 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.941858 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:56.941861 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:56.941863 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:56.941892 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:56.943030 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.943370 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.943373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.943374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.943438 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:56.943630 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:56.943631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:56.943632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:56.943803 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:56.943893 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.944038 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.944119 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:21:56.946542 525 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:56.949383 525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:56.963124 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.957072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:46527 (local address 127.0.0.1:37888)
0812 11:21:56.958645 (+ 1573us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.958656 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:56.958788 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:56.959152 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:56.959154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:56.959170 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:56.959257 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.959305 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.960360 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.960363 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.961555 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.961565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.962615 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.962619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.962724 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.962760 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:21:56.962867 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 11:21:56.962982 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1517,"mutex_wait_us":48,"thread_start_us":78,"threads_started":1}
I20260812 11:21:56.963140 1506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.957438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37888 (local address 127.12.175.195:46527)
0812 11:21:56.957890 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.957900 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.958729 (+ 829us) server_negotiation.cc:407] Connection header received
0812 11:21:56.958904 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.958908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.959028 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.959155 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:56.959435 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.960206 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.961711 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.962495 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.962619 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.962739 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.962903 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.962993 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":148,"threads_started":1}
I20260812 11:21:56.963470 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.956666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41417 (local address 127.0.0.1:36314)
0812 11:21:56.957368 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.957412 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:56.957556 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:56.958485 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:56.958488 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:56.958505 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:56.958599 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.958605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.960068 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.960072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.961533 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.961543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.962806 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.962809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.962901 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.962925 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:56.962992 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:21:56.963072 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":41,"spinlock_wait_cycles":2176,"thread_start_us":62,"threads_started":1}
I20260812 11:21:56.964020 1503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.957414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54630 (local address 127.12.175.193:33737)
0812 11:21:56.957948 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.957957 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.957976 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:21:56.958041 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.958046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.958251 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.958399 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:56.958668 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.959919 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.962366 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.963102 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.963216 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.963365 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.963832 (+ 467us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.963903 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":150,"threads_started":1}
I20260812 11:21:56.964264 1502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.956815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:33737 (local address 127.0.0.1:54630)
0812 11:21:56.957372 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.957414 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:56.957543 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:56.958382 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:56.958388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:56.958411 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:56.958525 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.958532 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.961476 (+ 2944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.961479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.962251 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:56.962260 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.963427 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.963431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:56.963515 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.963550 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:21:56.963617 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:21:56.963678 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"spinlock_wait_cycles":5248,"thread_start_us":85,"threads_started":1}
I20260812 11:21:56.964426 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.956831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.12.175.194:41417)
0812 11:21:56.958083 (+ 1252us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:56.958094 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:56.958113 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:21:56.958174 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:56.958177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:56.958357 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:56.958507 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:56.958719 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.959919 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.961649 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:56.962495 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:56.962618 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:56.962739 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:56.963200 (+ 461us) server_negotiation.cc:299] Negotiation successful
0812 11:21:56.963579 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1154,"thread_start_us":108,"threads_started":1}
I20260812 11:21:56.966061 1308 tablet_service.cc:1467] Processing CreateTablet for tablet e4f1a08ce18b4812a91bfcb841c4ac73 (DEFAULT_TABLE table=test-table [id=3ed7641ef8bb4c62ba5a35fb11f3aabd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:56.966691 775 tablet_service.cc:1467] Processing CreateTablet for tablet e4f1a08ce18b4812a91bfcb841c4ac73 (DEFAULT_TABLE table=test-table [id=3ed7641ef8bb4c62ba5a35fb11f3aabd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:56.967139 1308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f1a08ce18b4812a91bfcb841c4ac73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:56.967072 1054 tablet_service.cc:1467] Processing CreateTablet for tablet e4f1a08ce18b4812a91bfcb841c4ac73 (DEFAULT_TABLE table=test-table [id=3ed7641ef8bb4c62ba5a35fb11f3aabd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:56.967628 775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f1a08ce18b4812a91bfcb841c4ac73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:56.968050 1054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f1a08ce18b4812a91bfcb841c4ac73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:56.973551 1512 tablet_bootstrap.cc:492] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: Bootstrap starting.
I20260812 11:21:56.974916 1516 tablet_bootstrap.cc:492] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Bootstrap starting.
I20260812 11:21:56.975164 1515 tablet_bootstrap.cc:492] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Bootstrap starting.
I20260812 11:21:56.975783 1512 tablet_bootstrap.cc:654] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:56.976930 1516 tablet_bootstrap.cc:654] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:56.977064 1512 log.cc:824] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:56.977602 1515 tablet_bootstrap.cc:654] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:56.977629 1516 log.cc:824] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:56.978418 1515 log.cc:824] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:56.979326 1512 tablet_bootstrap.cc:492] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: No bootstrap required, opened a new log
I20260812 11:21:56.979511 1516 tablet_bootstrap.cc:492] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: No bootstrap required, opened a new log
I20260812 11:21:56.979576 1512 ts_tablet_manager.cc:1397] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:21:56.979689 1516 ts_tablet_manager.cc:1397] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:21:56.980727 1515 tablet_bootstrap.cc:492] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: No bootstrap required, opened a new log
I20260812 11:21:56.980906 1515 ts_tablet_manager.cc:1397] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:21:56.982692 1512 raft_consensus.cc:348] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:56.982904 1512 raft_consensus.cc:374] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:56.982975 1512 raft_consensus.cc:729] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 047afb8087fb41d3bd93ec2f8ab83f46, State: Initialized, Role: FOLLOWER
I20260812 11:21:56.983417 1512 consensus_queue.cc:260] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:56.983469 1516 raft_consensus.cc:348] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:56.983701 1516 raft_consensus.cc:374] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:56.983793 1516 raft_consensus.cc:729] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00d65184c3c84bbeb769b554f5f9337f, State: Initialized, Role: FOLLOWER
I20260812 11:21:56.984158 916 heartbeater.cc:503] Master 127.12.175.254:42249 was elected leader, sending a full tablet report...
I20260812 11:21:56.984225 1516 consensus_queue.cc:260] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:56.984356 1512 ts_tablet_manager.cc:1428] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:21:56.984407 1515 raft_consensus.cc:348] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:56.984640 1515 raft_consensus.cc:374] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:56.984694 1515 raft_consensus.cc:729] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abab159fa764d25ba21df0933266ec3, State: Initialized, Role: FOLLOWER
I20260812 11:21:56.985119 1516 ts_tablet_manager.cc:1428] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:21:56.985077 1515 consensus_queue.cc:260] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:56.985404 1180 heartbeater.cc:503] Master 127.12.175.254:42249 was elected leader, sending a full tablet report...
I20260812 11:21:56.986454 1462 heartbeater.cc:503] Master 127.12.175.254:42249 was elected leader, sending a full tablet report...
I20260812 11:21:56.987432 1515 ts_tablet_manager.cc:1428] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260812 11:21:56.989686 918 tablet.cc:2369] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:57.139855 1522 raft_consensus.cc:482] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:57.140046 1522 raft_consensus.cc:504] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:57.141199 1522 leader_election.cc:288] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00d65184c3c84bbeb769b554f5f9337f (127.12.175.194:41417), 7abab159fa764d25ba21df0933266ec3 (127.12.175.195:46527)
I20260812 11:21:57.144984 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.141528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:47509 (local address 127.12.175.194:41417)
0812 11:21:57.141660 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:57.141666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:57.141796 (+ 130us) server_negotiation.cc:407] Connection header received
0812 11:21:57.141973 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:57.141977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:57.142030 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:57.142091 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:57.142421 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.142918 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.144016 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.144400 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.144507 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.144569 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:57.144795 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 11:21:57.144861 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:21:57.144986 1506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.141592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:54591 (local address 127.12.175.195:46527)
0812 11:21:57.141704 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:57.141708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:57.141866 (+ 158us) server_negotiation.cc:407] Connection header received
0812 11:21:57.142003 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:57.142006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:57.142049 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:57.142117 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:57.142434 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.142916 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.144007 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.144400 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.144504 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.144568 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:57.144796 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:21:57.144867 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:21:57.145010 1534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.141431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:46527 (local address 127.12.175.193:54591)
0812 11:21:57.141793 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:57.141803 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:57.141907 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:57.142137 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:57.142139 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:57.142157 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:57.142327 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:57.142332 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.143015 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.143019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:57.143885 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:57.143895 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.144514 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.144517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:57.144645 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.144696 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 11:21:57.144762 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:21:57.144848 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":68,"thread_start_us":132,"threads_started":1}
I20260812 11:21:57.145017 1531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.141400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41417 (local address 127.12.175.193:47509)
0812 11:21:57.141698 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:57.141711 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:57.141837 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:57.142122 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:57.142125 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:57.142141 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:57.142317 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:57.142323 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.143026 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.143030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:57.143894 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:57.143903 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.144516 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.144519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:57.144666 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.144698 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:21:57.144761 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:21:57.144863 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":66,"spinlock_wait_cycles":13824,"thread_start_us":72,"threads_started":1}
I20260812 11:21:57.145618 1096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f1a08ce18b4812a91bfcb841c4ac73" candidate_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00d65184c3c84bbeb769b554f5f9337f" is_pre_election: true
I20260812 11:21:57.145716 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f1a08ce18b4812a91bfcb841c4ac73" candidate_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abab159fa764d25ba21df0933266ec3" is_pre_election: true
I20260812 11:21:57.145946 1096 raft_consensus.cc:2454] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 047afb8087fb41d3bd93ec2f8ab83f46 in term 0.
I20260812 11:21:57.145953 1341 raft_consensus.cc:2454] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 047afb8087fb41d3bd93ec2f8ab83f46 in term 0.
I20260812 11:21:57.146392 689 leader_election.cc:302] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00d65184c3c84bbeb769b554f5f9337f, 047afb8087fb41d3bd93ec2f8ab83f46; no voters:
I20260812 11:21:57.146625 1522 raft_consensus.cc:2781] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:57.146710 1522 raft_consensus.cc:482] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:57.146759 1522 raft_consensus.cc:3037] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:57.147769 1522 raft_consensus.cc:504] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:57.148062 1522 leader_election.cc:288] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [CANDIDATE]: Term 1 election: Requested vote from peers 00d65184c3c84bbeb769b554f5f9337f (127.12.175.194:41417), 7abab159fa764d25ba21df0933266ec3 (127.12.175.195:46527)
I20260812 11:21:57.148408 1096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f1a08ce18b4812a91bfcb841c4ac73" candidate_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00d65184c3c84bbeb769b554f5f9337f"
I20260812 11:21:57.148422 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f1a08ce18b4812a91bfcb841c4ac73" candidate_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abab159fa764d25ba21df0933266ec3"
I20260812 11:21:57.148535 1341 raft_consensus.cc:3037] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:57.148535 1096 raft_consensus.cc:3037] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:57.149775 1341 raft_consensus.cc:2454] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 047afb8087fb41d3bd93ec2f8ab83f46 in term 1.
I20260812 11:21:57.149775 1096 raft_consensus.cc:2454] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 047afb8087fb41d3bd93ec2f8ab83f46 in term 1.
I20260812 11:21:57.150022 689 leader_election.cc:302] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00d65184c3c84bbeb769b554f5f9337f, 047afb8087fb41d3bd93ec2f8ab83f46; no voters:
I20260812 11:21:57.150182 1522 raft_consensus.cc:2781] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:57.150390 1522 raft_consensus.cc:686] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 1 LEADER]: Becoming Leader. State: Replica: 047afb8087fb41d3bd93ec2f8ab83f46, State: Running, Role: LEADER
I20260812 11:21:57.150712 1522 consensus_queue.cc:237] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } }
I20260812 11:21:57.153709 522 catalog_manager.cc:5495] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 047afb8087fb41d3bd93ec2f8ab83f46 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "047afb8087fb41d3bd93ec2f8ab83f46" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 } health_report { overall_health: UNKNOWN } } }
W20260812 11:21:57.164017 1466 tablet.cc:2369] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:57.191150 1503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.188285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54646 (local address 127.12.175.193:33737)
0812 11:21:57.188401 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:57.188405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:57.188417 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:21:57.188497 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:57.188499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:57.188551 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:57.188631 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:57.188816 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.189291 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.190032 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.190233 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.190294 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.190515 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:57.190889 (+ 374us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:57.190970 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:57.191000 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 11:21:57.191054 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:21:57.196570 1096 raft_consensus.cc:1261] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 1 FOLLOWER]: Refusing update from remote peer 047afb8087fb41d3bd93ec2f8ab83f46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:57.196576 1341 raft_consensus.cc:1261] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 1 FOLLOWER]: Refusing update from remote peer 047afb8087fb41d3bd93ec2f8ab83f46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:57.197278 1522 consensus_queue.cc:1035] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abab159fa764d25ba21df0933266ec3" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:57.197465 1535 consensus_queue.cc:1035] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00d65184c3c84bbeb769b554f5f9337f" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:57.204368 1539 mvcc.cc:205] Tried to move back new op lower bound from 7317642105630707712 to 7317642105451974656. Current Snapshot: MvccSnapshot[applied={T|T < 7317642105630707712}]
I20260812 11:21:57.204718 1541 mvcc.cc:205] Tried to move back new op lower bound from 7317642105630707712 to 7317642105451974656. Current Snapshot: MvccSnapshot[applied={T|T < 7317642105630707712}]
I20260812 11:21:57.212945 522 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:57.213081 522 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:57.215163 522 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52631dca993c4dce9aec3c37d7901978: Sending DeleteTablet for 3 replicas of tablet e4f1a08ce18b4812a91bfcb841c4ac73
I20260812 11:21:57.215847 775 tablet_service.cc:1514] Processing DeleteTablet for tablet e4f1a08ce18b4812a91bfcb841c4ac73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:57 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:54630
I20260812 11:21:57.215966 1308 tablet_service.cc:1514] Processing DeleteTablet for tablet e4f1a08ce18b4812a91bfcb841c4ac73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:57 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:37888
I20260812 11:21:57.216288 1054 tablet_service.cc:1514] Processing DeleteTablet for tablet e4f1a08ce18b4812a91bfcb841c4ac73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:57 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:36314
I20260812 11:21:57.216567 1559 tablet_replica.cc:330] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46: stopping tablet replica
I20260812 11:21:57.216679 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 652
I20260812 11:21:57.216852 1559 raft_consensus.cc:2229] T e4f1a08ce18b4812a91bfcb841c4ac73 P 047afb8087fb41d3bd93ec2f8ab83f46 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:57.220139 1564 tablet_replica.cc:330] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: stopping tablet replica
I20260812 11:21:57.220345 1564 raft_consensus.cc:2229] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:57.220546 1564 raft_consensus.cc:2258] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:57.220799 1560 tablet_replica.cc:330] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: stopping tablet replica
I20260812 11:21:57.221012 1560 raft_consensus.cc:2229] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:57.221216 1560 raft_consensus.cc:2258] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:57.223307 1564 ts_tablet_manager.cc:1905] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:57.225509 1564 ts_tablet_manager.cc:1918] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:57.225584 1564 log.cc:1196] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/e4f1a08ce18b4812a91bfcb841c4ac73
I20260812 11:21:57.225804 1564 ts_tablet_manager.cc:1939] T e4f1a08ce18b4812a91bfcb841c4ac73 P 00d65184c3c84bbeb769b554f5f9337f: Deleting consensus metadata
I20260812 11:21:57.226920 502 catalog_manager.cc:4841] TS 00d65184c3c84bbeb769b554f5f9337f (127.12.175.194:41417): tablet e4f1a08ce18b4812a91bfcb841c4ac73 (table test-table [id=3ed7641ef8bb4c62ba5a35fb11f3aabd]) successfully deleted
I20260812 11:21:57.227972 1560 ts_tablet_manager.cc:1905] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:57.229883 1560 ts_tablet_manager.cc:1918] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:57.229970 1560 log.cc:1196] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/e4f1a08ce18b4812a91bfcb841c4ac73
I20260812 11:21:57.231385 1560 ts_tablet_manager.cc:1939] T e4f1a08ce18b4812a91bfcb841c4ac73 P 7abab159fa764d25ba21df0933266ec3: Deleting consensus metadata
I20260812 11:21:57.232339 501 catalog_manager.cc:4841] TS 7abab159fa764d25ba21df0933266ec3 (127.12.175.195:46527): tablet e4f1a08ce18b4812a91bfcb841c4ac73 (table test-table [id=3ed7641ef8bb4c62ba5a35fb11f3aabd]) successfully deleted
W20260812 11:21:57.237915 499 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:33737 (error 108)
I20260812 11:21:57.238214 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 924
I20260812 11:21:57.254181 1502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.253811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:33737 (local address 127.0.0.1:54648)
0812 11:21:57.254013 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:57.254097 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:33737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260812 11:21:57.254359 499 catalog_manager.cc:4584] TS 047afb8087fb41d3bd93ec2f8ab83f46 (127.12.175.193:33737): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e4f1a08ce18b4812a91bfcb841c4ac73: Network error: Client connection negotiation failed: client connection to 127.12.175.193:33737: connect: Connection refused (error 111)
I20260812 11:21:57.258477 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 1201
I20260812 11:21:57.273607 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 467
2026-08-12T11:21:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2529 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:57 dist-test-slave-gjrz krb5kdc[1573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:57 dist-test-slave-gjrz krb5kdc[1573](info): set up 2 sockets
Aug 12 11:21:57 dist-test-slave-gjrz krb5kdc[1573](info): commencing operation
krb5kdc: starting...
W20260812 11:21:58.469138 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:21:58 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/rangeradmin_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/rangeradmin_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/rangerlookup_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/rangerlookup_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
I20260812 11:21:58.621979 12991 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNqPwv8/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/postgres -l logfile start
2026-08-12 11:22:00.791 UTC [1635] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:22:00.791 UTC [1635] LOG: listening on IPv4 address "127.12.175.212", port 44187
2026-08-12 11:22:00.794 UTC [1635] LOG: listening on Unix socket "/tmp/.s.PGSQL.44187"
2026-08-12 11:22:00.813 UTC [1646] LOG: database system was shut down at 2026-08-12 11:21:59 UTC
2026-08-12 11:22:00.817 UTC [1635] LOG: database system is ready to accept connections
I20260812 11:22:01.923909 12991 mini_postgres.cc:96] Postgres bound to 44187
2026-08-12 11:22:01.931 UTC [1662] FATAL: database "slave" does not exist
127.12.175.212:44187 - accepting connections
I20260812 11:22:01.931797 12991 mini_ranger.cc:161] Starting Ranger...
I20260812 11:22:01.946231 12991 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:22:02.347497 12991 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:22:02.347589 12991 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-admin
2026-08-12 11:22:02,618 [I] DB FLAVOR :POSTGRES
2026-08-12 11:22:02,618 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:22:02,618 [I] Checking connection..
2026-08-12 11:22:02,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:22:02,865 [I] Checking connection passed.
2026-08-12 11:22:02,865 [I] --------- Verifying version history table ---------
2026-08-12 11:22:02,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:22:03,101 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:22:03,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:22:03,350 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:22:03,351 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:22:03,351 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:22:03.574 UTC [1800] WARNING: there is no transaction in progress
2026-08-12 11:22:03,580 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:22:03,580 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:22:03,806 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:22:03,806 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:22:03,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:22:04,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:22:04,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-12 11:22:04,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:22:04,769 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:22:04,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:22:05,000 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:22:05,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:22:05,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:22:05,506 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:22:05,506 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:22:06.394 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.408 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.422 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.435 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.448 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.464 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.513 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.519 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.532 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.541 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.550 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.562 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.575 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.584 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.593 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:06.599 UTC [2014] WARNING: there is no transaction in progress
2026-08-12 11:22:07,140 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:22:07,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:22:07,378 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:22:07,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:22:07,613 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:22:07,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:22:07,861 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:22:07,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:22:08,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:22:08,348 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-12 11:22:08,581 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:22:08,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:22:08,813 [I] DB_PATCHES have already been applied
I20260812 11:22:08.819015 12991 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNqPwv8/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:22:08.819077 12991 mini_ranger.cc:193] Using host: 127.12.175.212
I20260812 11:22:08.823331 12991 mini_ranger.cc:227] Ranger admin URL: http://127.12.175.212:33953
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:22:09 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:22:10.081514 12991 mini_ranger.cc:160] Time spent starting Ranger: real 8.150s user 0.007s sys 0.003s
Aug 12, 2026 11:22:29 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:22:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 11:22:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:22:29 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:22:30 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:22:31.320983 12991 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/rangerkms_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/rangerkms_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.175.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.175.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:22:31 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533751, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:22:31.410038 12991 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:22:31.419687 12991 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:22:32.158354 12991 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:22:32.158434 12991 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms
I20260812 11:22:32.158511 12991 mini_ranger_kms.cc:227] Using postgres at 127.12.175.212:44187
2026-08-12 11:22:32,330 [I] DB FLAVOR :POSTGRES
2026-08-12 11:22:32,330 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:22:32,330 [I] Checking connection
2026-08-12 11:22:32,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:22:32,569 [I] connection success
2026-08-12 11:22:32,569 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:22:32,569 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:22:32,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:22:32,822 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:22:32,822 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:22:32,822 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:22:32,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:44187/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:22:33,074 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:22:33.540771 12991 mini_ranger_kms.cc:310] Created kms service
I20260812 11:22:33.753914 12991 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:22:33.795174 12991 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:22:33 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533751, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:22:34.158747 12991 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:22:34.158900 12991 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:22:34.158922 12991 mini_ranger_kms.cc:240] Using host: 127.12.175.212
I20260812 11:22:34.163632 12991 mini_ranger_kms.cc:276] Ranger KMS PID: 2357
I20260812 11:22:34.163774 12991 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.175.212:57257
Aug 12, 2026 11:22:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:22:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:22:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:22:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:22:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:22:35 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:22:36 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533756, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.175.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 11:22:36 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533756, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.175.212@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:22:36.806187 12991 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.396s user 0.011s sys 0.146s
I20260812 11:22:36.806318 12991 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:22:36.806430 12991 mini_ranger_kms.cc:401] 127.12.175.212:57257/kms/v1/keys
Aug 12 11:22:37 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533756, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.175.212@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
Aug 12 11:22:39 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:22:39.307904 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43063
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:43063
--ranger_config_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:57257/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:39.417469 2461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:39.417709 2461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:39.417761 2461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:39.421604 2461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:39.421654 2461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:39.421681 2461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:39.421703 2461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:39.421731 2461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:39.427244 2461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.175.212:57257/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:43063
--ranger_config_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:22:39.428170 2461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:39.429102 2461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:39.437448 2475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:39.437463 2476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:39.437789 2461 server_base.cc:1034] running on GCE node
W20260812 11:22:39.437463 2478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:39.438380 2461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:39.439435 2461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:39.440606 2461 hybrid_clock.cc:648] HybridClock initialized: now 1786533759440591 us; error 29 us; skew 500 ppm
Aug 12 11:22:39 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533759, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:39.443475 2461 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:22:39.444468 2461 webserver.cc:460] Webserver started at http://127.12.175.254:41293/ using document root <none> and password file <none>
I20260812 11:22:39.445081 2461 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:39.445153 2461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:39.445381 2461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:22:39 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533759, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:22:39.502969 2461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "03682042aa784cb69f81625abd3120a9"
format_stamp: "Formatted at 2026-08-12 11:22:39 on dist-test-slave-gjrz"
server_key: "54ee45fd747aaa4b1c7dea0fd70965d2"
server_key_iv: "1719037be04793935fa9087d9ddce2a9"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:39.503722 2461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "03682042aa784cb69f81625abd3120a9"
format_stamp: "Formatted at 2026-08-12 11:22:39 on dist-test-slave-gjrz"
server_key: "54ee45fd747aaa4b1c7dea0fd70965d2"
server_key_iv: "1719037be04793935fa9087d9ddce2a9"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:39.508553 2461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:22:39.524515 2491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:39.526046 2461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:39.526180 2461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "03682042aa784cb69f81625abd3120a9"
format_stamp: "Formatted at 2026-08-12 11:22:39 on dist-test-slave-gjrz"
server_key: "54ee45fd747aaa4b1c7dea0fd70965d2"
server_key_iv: "1719037be04793935fa9087d9ddce2a9"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:39.526302 2461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:39.545706 2461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:39.548581 2461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:39.548760 2461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:39.557053 2461 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:43063
I20260812 11:22:39.557090 2592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:43063 every 8 connection(s)
I20260812 11:22:39.558159 2461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:39.561007 2593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:39.564531 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 2461
I20260812 11:22:39.564651 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:22:39.564956 12991 external_mini_cluster.cc:1428] Setting key 7ec46fd75e5080613657c025fd234ff8
I20260812 11:22:39.567018 2593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9: Bootstrap starting.
I20260812 11:22:39.569372 2593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:39.570087 2593 log.cc:824] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:39.572077 2593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9: No bootstrap required, opened a new log
Aug 12 11:22:39 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:22:39.575949 2593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03682042aa784cb69f81625abd3120a9" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43063 } }
I20260812 11:22:39.576234 2593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:39.576278 2593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03682042aa784cb69f81625abd3120a9, State: Initialized, Role: FOLLOWER
I20260812 11:22:39.576722 2593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03682042aa784cb69f81625abd3120a9" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43063 } }
I20260812 11:22:39.576884 2593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:39.576980 2593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:39.577105 2593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:39.578146 2593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03682042aa784cb69f81625abd3120a9" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43063 } }
I20260812 11:22:39.578475 2593 leader_election.cc:302] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03682042aa784cb69f81625abd3120a9; no voters:
I20260812 11:22:39.578867 2593 leader_election.cc:288] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:39.578940 2602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:39.579226 2602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [term 1 LEADER]: Becoming Leader. State: Replica: 03682042aa784cb69f81625abd3120a9, State: Running, Role: LEADER
I20260812 11:22:39.579574 2602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03682042aa784cb69f81625abd3120a9" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43063 } }
I20260812 11:22:39.580317 2593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:39.580756 2602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03682042aa784cb69f81625abd3120a9. Latest consensus state: current_term: 1 leader_uuid: "03682042aa784cb69f81625abd3120a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03682042aa784cb69f81625abd3120a9" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43063 } } }
I20260812 11:22:39.580895 2602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:39.581141 2602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03682042aa784cb69f81625abd3120a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03682042aa784cb69f81625abd3120a9" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43063 } } }
I20260812 11:22:39.581261 2602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:39.581591 2599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:39.566376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.12.175.254:43063)
0812 11:22:39.566829 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:39.566848 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:39.566890 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:22:39.567747 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:39.567771 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:39.568174 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:39.568534 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:39.569390 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:39.570949 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:39.572119 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:39.572828 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:39.572978 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:39.575901 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:39.575907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:39.575922 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:39.575953 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:39.577868 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:39.578335 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:39.578341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:39.578347 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:39.578486 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:39.578794 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:39.578797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:39.578798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:39.579293 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:39.580129 (+ 836us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:39.580269 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 11:22:39.580570 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":128,"threads_started":1}
I20260812 11:22:39.582667 2593 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:22:39.587247 2608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:39.591321 2608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:39.597762 2608 catalog_manager.cc:1347] Generated new cluster ID: d0ea1355493a486fb26e22a64b8e8e69
I20260812 11:22:39.597815 2608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:39.611248 2608 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:39.612491 2608 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:39.618783 2608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9: Generated new TSK 0
I20260812 11:22:39.619596 2608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:22:40.329811 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:57257/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43063
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:40.487095 2683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:40.487432 2683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:40.487516 2683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:40.493244 2683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:40.493316 2683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:40.493395 2683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:22:40.500388 2683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.175.212:57257/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:22:40.501502 2683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:40.502823 2683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:40.515311 2701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:40.515430 2697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:40.515317 2698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:40.515887 2683 server_base.cc:1034] running on GCE node
I20260812 11:22:40.516326 2683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:40.517098 2683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:40.518308 2683 hybrid_clock.cc:648] HybridClock initialized: now 1786533760518281 us; error 32 us; skew 500 ppm
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:40.521617 2683 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:22:40.522728 2683 webserver.cc:460] Webserver started at http://127.12.175.193:32817/ using document root <none> and password file <none>
I20260812 11:22:40.523455 2683 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:40.523563 2683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:40.523819 2683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:22:40.548970 2683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "b3c3c4e04de1464b841968724cacf58d"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-gjrz"
server_key: "cec7fa341e8ec3d2b9f911d6a399b0fa"
server_key_iv: "c105c8216176bf8eab398845f44451b8"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:40.549676 2683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "b3c3c4e04de1464b841968724cacf58d"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-gjrz"
server_key: "cec7fa341e8ec3d2b9f911d6a399b0fa"
server_key_iv: "c105c8216176bf8eab398845f44451b8"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:40.554826 2683 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:22:40.580245 2716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.581799 2683 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:22:40.581943 2683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "b3c3c4e04de1464b841968724cacf58d"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-gjrz"
server_key: "cec7fa341e8ec3d2b9f911d6a399b0fa"
server_key_iv: "c105c8216176bf8eab398845f44451b8"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:40.582068 2683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:40.601871 2683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:40.605204 2683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:40.605428 2683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:40.606118 2683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:40.607161 2683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:40.607296 2683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.607424 2683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:40.607503 2683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.621024 2683 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:39737
I20260812 11:22:40.622159 2683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:40.625023 2940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:39737 every 8 connection(s)
I20260812 11:22:40.629424 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 2683
I20260812 11:22:40.629550 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:40.629887 12991 external_mini_cluster.cc:1428] Setting key e4edd01e34a4e9f893d33bfc89b39ad0
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:22:40.639407 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:40.626630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:33537 (local address 127.12.175.254:43063)
0812 11:22:40.626915 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:40.626920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:40.626936 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:22:40.627410 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:40.627414 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:40.627469 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:40.627565 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:40.628957 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.629875 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.631699 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.632125 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.632223 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:40.635022 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:40.635026 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:40.635029 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:40.635066 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:40.636999 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:40.637631 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:40.637635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:40.637637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:40.637735 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:40.638130 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:40.638134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:40.638136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:40.638345 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:40.638440 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:40.639067 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 11:22:40.639192 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":89,"threads_started":1}
I20260812 11:22:40.640378 2945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:40.625516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43063 (local address 127.12.175.193:33537)
0812 11:22:40.626082 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:40.626138 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:40.627146 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:40.627762 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:40.627771 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:40.628113 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:40.628766 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:40.628787 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.630034 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.630049 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:40.631559 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:40.631572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.632391 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.632395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:40.632582 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:40.633173 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:40.633193 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:40.634839 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:40.637134 (+ 2295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:40.637139 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:40.637153 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:40.637514 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:40.637833 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:40.637836 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:40.637838 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:40.638029 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:40.638467 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:40.638474 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:40.638792 (+ 318us) client_negotiation.cc:769] Sending connection context
0812 11:22:40.639009 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 11:22:40.639381 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":148,"threads_started":1}
I20260812 11:22:40.641664 2941 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43063
I20260812 11:22:40.641928 2941 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:40.642488 2941 heartbeater.cc:511] Master 127.12.175.254:43063 requested a full tablet report, sending...
I20260812 11:22:40.644214 2519 ts_manager.cc:194] Registered new tserver with Master: b3c3c4e04de1464b841968724cacf58d (127.12.175.193:39737)
I20260812 11:22:40.645663 2519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:33537
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:22:40.670599 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:57257/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43063
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:22:40.824863 2953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:40.825181 2953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:40.825242 2953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:40.831102 2953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:40.831168 2953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:40.831247 2953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:22:40.838609 2953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.175.212:57257/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:22:40.839851 2953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:40.841126 2953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:40.852999 2971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:40.853320 2964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:40.853631 2967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:40.855422 2953 server_base.cc:1034] running on GCE node
I20260812 11:22:40.855880 2953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:40.856652 2953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:40.857834 2953 hybrid_clock.cc:648] HybridClock initialized: now 1786533760857807 us; error 54 us; skew 500 ppm
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:40.861402 2953 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:22:40.862506 2953 webserver.cc:460] Webserver started at http://127.12.175.194:35075/ using document root <none> and password file <none>
I20260812 11:22:40.863211 2953 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:40.863428 2953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:40.863739 2953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:22:40.880174 2953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "97142026aa2d418e8885f7099a97b62d"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-gjrz"
server_key: "4360f8355166498b77add5071d4aa903"
server_key_iv: "083a0fb5c74d1aedd296c4c016ba42ab"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:40.880854 2953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "97142026aa2d418e8885f7099a97b62d"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-gjrz"
server_key: "4360f8355166498b77add5071d4aa903"
server_key_iv: "083a0fb5c74d1aedd296c4c016ba42ab"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:40.890698 2953 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.000s
I20260812 11:22:40.907655 2984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.909231 2953 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 11:22:40.909345 2953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "97142026aa2d418e8885f7099a97b62d"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-gjrz"
server_key: "4360f8355166498b77add5071d4aa903"
server_key_iv: "083a0fb5c74d1aedd296c4c016ba42ab"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:40.909458 2953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:40.938285 2953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:40.947621 2953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:40.947800 2953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:40.948496 2953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:40.949496 2953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:40.949554 2953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.949605 2953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:40.949673 2953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.960295 2953 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:45565
I20260812 11:22:40.960366 3194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:45565 every 8 connection(s)
I20260812 11:22:40.961462 2953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:40.970290 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 2953
I20260812 11:22:40.970418 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:40.970744 12991 external_mini_cluster.cc:1428] Setting key 694ad21f7b4c63a15d87ff2d37608329
Aug 12 11:22:40 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
I20260812 11:22:40.985891 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:40.966553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:60339 (local address 127.12.175.254:43063)
0812 11:22:40.966686 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:40.966690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:40.971686 (+ 4996us) server_negotiation.cc:407] Connection header received
0812 11:22:40.973818 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:40.973822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:40.973878 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:40.973935 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:40.975618 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.976453 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.978277 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.978631 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.978713 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:40.981662 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:40.981666 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:40.981669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:40.981696 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:40.983479 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:40.984111 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:40.984115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:40.984117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:40.984210 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:40.984639 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:40.984643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:40.984645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:40.984863 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:40.984988 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:40.985596 (+ 608us) server_negotiation.cc:299] Negotiation successful
0812 11:22:40.985729 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:22:40.986766 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:40.967032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43063 (local address 127.12.175.194:60339)
0812 11:22:40.971541 (+ 4509us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:40.971596 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:40.973550 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:40.974363 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:40.974373 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:40.974720 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:40.975431 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:40.975456 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.976622 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.976625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:40.978123 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:40.978135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.978917 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.978922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:40.979143 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:40.979784 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:40.979805 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:40.981468 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:40.983612 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:40.983617 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:40.983632 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:40.983966 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:40.984326 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:40.984329 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:40.984331 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:40.984500 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:40.984989 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:40.984996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:40.985305 (+ 309us) client_negotiation.cc:769] Sending connection context
0812 11:22:40.985505 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 11:22:40.985808 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4242,"thread_start_us":162,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
I20260812 11:22:40.988245 3195 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43063
I20260812 11:22:40.988477 3195 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:40.989028 3195 heartbeater.cc:511] Master 127.12.175.254:43063 requested a full tablet report, sending...
I20260812 11:22:40.990161 2519 ts_manager.cc:194] Registered new tserver with Master: 97142026aa2d418e8885f7099a97b62d (127.12.175.194:45565)
I20260812 11:22:40.990882 2519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:60339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:22:41.014086 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:57257/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43063
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:22:41 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
W20260812 11:22:41.168355 3203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:41.168591 3203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:41.168648 3203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:41.172782 3203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:41.172843 3203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:41.172926 3203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:22:41.177951 3203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.175.212:57257/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:22:41.178876 3203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:41.179858 3203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:41.190579 3216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:41.190585 3215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:41.190896 3203 server_base.cc:1034] running on GCE node
W20260812 11:22:41.190657 3222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:41.193862 3203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:41.194446 3203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:41.195616 3203 hybrid_clock.cc:648] HybridClock initialized: now 1786533761195579 us; error 54 us; skew 500 ppm
Aug 12 11:22:41 dist-test-slave-gjrz krb5kdc[1573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533761, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:41.198406 3203 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:22:41.199211 3203 webserver.cc:460] Webserver started at http://127.12.175.195:41705/ using document root <none> and password file <none>
I20260812 11:22:41.199774 3203 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:41.199836 3203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:41.200055 3203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:22:41 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533761, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:22:41.216511 3203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "b14fb8ae86704d4c8a7e6f25f2721877"
format_stamp: "Formatted at 2026-08-12 11:22:41 on dist-test-slave-gjrz"
server_key: "74f1c2cce4a7186a2725d53569925cdb"
server_key_iv: "c48526cbf60b41c4f455826ad80417fc"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:41.217258 3203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "b14fb8ae86704d4c8a7e6f25f2721877"
format_stamp: "Formatted at 2026-08-12 11:22:41 on dist-test-slave-gjrz"
server_key: "74f1c2cce4a7186a2725d53569925cdb"
server_key_iv: "c48526cbf60b41c4f455826ad80417fc"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:41.222836 3203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:22:41.240873 3240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:41.242445 3203 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:22:41.242564 3203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "b14fb8ae86704d4c8a7e6f25f2721877"
format_stamp: "Formatted at 2026-08-12 11:22:41 on dist-test-slave-gjrz"
server_key: "74f1c2cce4a7186a2725d53569925cdb"
server_key_iv: "c48526cbf60b41c4f455826ad80417fc"
server_key_version: "kuduclusterkey@0"
I20260812 11:22:41.242671 3203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:41.270972 3203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:41.274201 3203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:41.274432 3203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:41.275166 3203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:41.276227 3203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:41.276322 3203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:41.276419 3203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:41.276475 3203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:41.286880 3203 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:40863
I20260812 11:22:41.286942 3454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:40863 every 8 connection(s)
I20260812 11:22:41.287935 3203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:41.291728 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 3203
I20260812 11:22:41.291852 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:41.292169 12991 external_mini_cluster.cc:1428] Setting key 5edbe8e6ce8d32400d0fff1f43b876f1
Aug 12 11:22:41 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533761, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:22:41.301247 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.289592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:38757 (local address 127.12.175.254:43063)
0812 11:22:41.289716 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.289721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.290672 (+ 951us) server_negotiation.cc:407] Connection header received
0812 11:22:41.291786 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.291789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.291848 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.291916 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:41.293677 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.294398 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.295554 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.295774 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.295859 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.298004 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:41.298008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:41.298011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:41.298037 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:41.299323 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:41.299840 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:41.299843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:41.299845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:41.299945 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:41.300250 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:41.300254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:41.300255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:41.300429 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:41.300515 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.300974 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.301096 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:22:41.302017 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.290022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43063 (local address 127.12.175.195:38757)
0812 11:22:41.290521 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.290573 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:41.291530 (+ 957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:41.292329 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:41.292338 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:41.292862 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:41.293524 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.293545 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.294524 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.294526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.295444 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.295454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.295916 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.295920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.296095 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.296617 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:41.296632 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:41.297848 (+ 1216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:41.299455 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:41.299461 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:41.299474 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:41.299746 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:41.300029 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:41.300032 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:41.300034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:41.300162 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:41.300525 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:41.300532 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:41.300749 (+ 217us) client_negotiation.cc:769] Sending connection context
0812 11:22:41.300908 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:22:41.301184 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":173,"threads_started":1}
I20260812 11:22:41.303244 3456 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43063
I20260812 11:22:41.303462 3456 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:41.303861 3456 heartbeater.cc:511] Master 127.12.175.254:43063 requested a full tablet report, sending...
I20260812 11:22:41.305078 2519 ts_manager.cc:194] Registered new tserver with Master: b14fb8ae86704d4c8a7e6f25f2721877 (127.12.175.195:40863)
I20260812 11:22:41.305601 2519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:38757
I20260812 11:22:41.308018 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:41.317919 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.310154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51988 (local address 127.12.175.254:43063)
0812 11:22:41.310252 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.310256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.310473 (+ 217us) server_negotiation.cc:407] Connection header received
0812 11:22:41.310574 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.310577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.310618 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.310679 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:41.311336 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.311819 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.312817 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.313164 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.313240 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.314931 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:41.314935 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:41.314938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:41.314962 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:41.316478 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:41.316845 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:41.316849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:41.316851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:41.316927 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:41.317174 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:41.317177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:41.317179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:41.317337 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:41.317457 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.317679 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.317777 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:22:41.320422 2519 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51988:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:41.323421 2519 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:41.340927 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.333134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.12.175.195:40863)
0812 11:22:41.333590 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.333602 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.335576 (+ 1974us) server_negotiation.cc:407] Connection header received
0812 11:22:41.335684 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.335689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.335838 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.335963 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:41.336368 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.337456 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.339227 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.340043 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.340130 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.340264 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.340671 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.340768 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":140,"threads_started":1}
I20260812 11:22:41.341555 3484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.332950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40863 (local address 127.0.0.1:33338)
0812 11:22:41.335486 (+ 2536us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.335499 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:41.335587 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:41.335958 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:41.335961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:41.336125 (+ 164us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:41.336240 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.336246 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.337592 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.337595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.339063 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.339074 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.340356 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.340359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.340467 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.340503 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:22:41.341319 (+ 816us) client_negotiation.cc:240] Negotiation successful
0812 11:22:41.341426 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2479,"mutex_wait_us":27,"thread_start_us":85,"threads_started":1}
I20260812 11:22:41.341629 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.333339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41280 (local address 127.12.175.193:39737)
0812 11:22:41.334853 (+ 1514us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.334857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.334876 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:22:41.334946 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.334950 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.335098 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.335227 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:41.336094 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.337914 (+ 1820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.339306 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.340800 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.340903 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.341027 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.341401 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.341506 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1429,"thread_start_us":106,"threads_started":1}
I20260812 11:22:41.342007 3477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.332239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39737 (local address 127.0.0.1:41280)
0812 11:22:41.334501 (+ 2262us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.334544 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:41.334643 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:41.335237 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:41.335242 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:41.335287 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:41.335432 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.335441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.338040 (+ 2599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.338043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.339154 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.339163 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.341094 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.341098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.341205 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.341227 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:22:41.341288 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:22:41.341922 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2094,"mutex_wait_us":514,"thread_start_us":103,"threads_started":1}
I20260812 11:22:41.345201 2821 tablet_service.cc:1467] Processing CreateTablet for tablet e160059db1a446038e0e6b015d00d594 (DEFAULT_TABLE table=test-table [id=73cf27b6685b4756bb09cc7833e5b7a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:41.345202 3303 tablet_service.cc:1467] Processing CreateTablet for tablet e160059db1a446038e0e6b015d00d594 (DEFAULT_TABLE table=test-table [id=73cf27b6685b4756bb09cc7833e5b7a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:41.346352 3303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e160059db1a446038e0e6b015d00d594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:41.346352 2821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e160059db1a446038e0e6b015d00d594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:41.355602 3489 tablet_bootstrap.cc:492] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: Bootstrap starting.
I20260812 11:22:41.356705 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.333741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:45565 (local address 127.0.0.1:39064)
0812 11:22:41.338586 (+ 4845us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.338601 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:41.338701 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:41.339352 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:41.339355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:41.339372 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:41.339466 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.339472 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.340850 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.340854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.341997 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.342009 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.356249 (+ 14240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.356253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.356363 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.356390 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:22:41.356474 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:22:41.356567 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4779,"thread_start_us":90,"threads_started":1}
I20260812 11:22:41.356769 3485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.333888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39064 (local address 127.12.175.194:45565)
0812 11:22:41.334459 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.334472 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.338792 (+ 4320us) server_negotiation.cc:407] Connection header received
0812 11:22:41.338871 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.338876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.339052 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.339191 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:41.339604 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.340722 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.342165 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.356079 (+ 13914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.356205 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.356340 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.356511 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.356619 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":95,"threads_started":1}
I20260812 11:22:41.358129 3489 tablet_bootstrap.cc:654] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:41.358968 3489 log.cc:824] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:41.359705 3488 tablet_bootstrap.cc:492] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Bootstrap starting.
I20260812 11:22:41.361467 3067 tablet_service.cc:1467] Processing CreateTablet for tablet e160059db1a446038e0e6b015d00d594 (DEFAULT_TABLE table=test-table [id=73cf27b6685b4756bb09cc7833e5b7a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:41.362483 3488 tablet_bootstrap.cc:654] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:41.362565 3067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e160059db1a446038e0e6b015d00d594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:41.363428 3488 log.cc:824] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:41.365567 3488 tablet_bootstrap.cc:492] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: No bootstrap required, opened a new log
I20260812 11:22:41.365763 3488 ts_tablet_manager.cc:1397] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:22:41.369931 3488 raft_consensus.cc:348] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.370209 3488 raft_consensus.cc:374] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:41.370265 3488 raft_consensus.cc:729] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14fb8ae86704d4c8a7e6f25f2721877, State: Initialized, Role: FOLLOWER
I20260812 11:22:41.370882 3488 consensus_queue.cc:260] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.371884 3489 tablet_bootstrap.cc:492] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: No bootstrap required, opened a new log
I20260812 11:22:41.372092 3489 ts_tablet_manager.cc:1397] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.003s
I20260812 11:22:41.372100 3488 ts_tablet_manager.cc:1428] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 11:22:41.372516 3456 heartbeater.cc:503] Master 127.12.175.254:43063 was elected leader, sending a full tablet report...
I20260812 11:22:41.376284 3489 raft_consensus.cc:348] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.376531 3489 raft_consensus.cc:374] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:41.376583 3489 raft_consensus.cc:729] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c3c4e04de1464b841968724cacf58d, State: Initialized, Role: FOLLOWER
I20260812 11:22:41.377013 3489 consensus_queue.cc:260] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.377949 3489 ts_tablet_manager.cc:1428] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:22:41.378300 2941 heartbeater.cc:503] Master 127.12.175.254:43063 was elected leader, sending a full tablet report...
I20260812 11:22:41.378577 3496 tablet_bootstrap.cc:492] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Bootstrap starting.
I20260812 11:22:41.381135 3496 tablet_bootstrap.cc:654] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:41.381950 3496 log.cc:824] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:41.384100 3496 tablet_bootstrap.cc:492] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: No bootstrap required, opened a new log
I20260812 11:22:41.384272 3496 ts_tablet_manager.cc:1397] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 11:22:41.388218 3496 raft_consensus.cc:348] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.388464 3496 raft_consensus.cc:374] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:41.388515 3496 raft_consensus.cc:729] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97142026aa2d418e8885f7099a97b62d, State: Initialized, Role: FOLLOWER
I20260812 11:22:41.388912 3496 consensus_queue.cc:260] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.390017 3195 heartbeater.cc:503] Master 127.12.175.254:43063 was elected leader, sending a full tablet report...
I20260812 11:22:41.390398 3496 ts_tablet_manager.cc:1428] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
Aug 12 11:22:41 dist-test-slave-gjrz krb5kdc[1573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
W20260812 11:22:41.462779 3196 tablet.cc:2369] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:41.549885 3458 tablet.cc:2369] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:41.550658 3499 raft_consensus.cc:482] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:41.550906 3499 raft_consensus.cc:504] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.552448 3499 leader_election.cc:288] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97142026aa2d418e8885f7099a97b62d (127.12.175.194:45565), b14fb8ae86704d4c8a7e6f25f2721877 (127.12.175.195:40863)
I20260812 11:22:41.563490 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.554006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:57713 (local address 127.12.175.195:40863)
0812 11:22:41.554120 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.554125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.557713 (+ 3588us) server_negotiation.cc:407] Connection header received
0812 11:22:41.557909 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.557913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.557965 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.558015 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:41.558506 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.559339 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.560994 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.561611 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.561708 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.561764 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.563242 (+ 1478us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.563354 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:22:41.564105 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.553628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40863 (local address 127.12.175.193:57713)
0812 11:22:41.557630 (+ 4002us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.557643 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:41.557785 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:41.558174 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:41.558177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:41.558196 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:41.558349 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.558356 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.559513 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.559516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.560850 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.560862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.562985 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.562989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.563089 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.563114 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:22:41.563877 (+ 763us) client_negotiation.cc:240] Negotiation successful
0812 11:22:41.563960 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3927,"thread_start_us":105,"threads_started":1}
I20260812 11:22:41.564908 3332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e160059db1a446038e0e6b015d00d594" candidate_uuid: "b3c3c4e04de1464b841968724cacf58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" is_pre_election: true
I20260812 11:22:41.565229 3332 raft_consensus.cc:2454] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3c3c4e04de1464b841968724cacf58d in term 0.
I20260812 11:22:41.565757 2720 leader_election.cc:302] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14fb8ae86704d4c8a7e6f25f2721877, b3c3c4e04de1464b841968724cacf58d; no voters:
I20260812 11:22:41.566066 3499 raft_consensus.cc:2781] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:41.566146 3499 raft_consensus.cc:482] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:41.566188 3499 raft_consensus.cc:3037] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:41.567746 3499 raft_consensus.cc:504] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.568120 3499 leader_election.cc:288] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [CANDIDATE]: Term 1 election: Requested vote from peers 97142026aa2d418e8885f7099a97b62d (127.12.175.194:45565), b14fb8ae86704d4c8a7e6f25f2721877 (127.12.175.195:40863)
I20260812 11:22:41.568663 3332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e160059db1a446038e0e6b015d00d594" candidate_uuid: "b3c3c4e04de1464b841968724cacf58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14fb8ae86704d4c8a7e6f25f2721877"
I20260812 11:22:41.568786 3332 raft_consensus.cc:3037] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:41.570065 3332 raft_consensus.cc:2454] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3c3c4e04de1464b841968724cacf58d in term 1.
I20260812 11:22:41.570487 2720 leader_election.cc:302] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14fb8ae86704d4c8a7e6f25f2721877, b3c3c4e04de1464b841968724cacf58d; no voters:
I20260812 11:22:41.570716 3499 raft_consensus.cc:2781] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:41.571031 3499 raft_consensus.cc:686] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [term 1 LEADER]: Becoming Leader. State: Replica: b3c3c4e04de1464b841968724cacf58d, State: Running, Role: LEADER
I20260812 11:22:41.571426 3499 consensus_queue.cc:237] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } }
I20260812 11:22:41.573686 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.552920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:45565 (local address 127.12.175.193:39453)
0812 11:22:41.557230 (+ 4310us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.557246 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:41.557370 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:41.569921 (+ 12551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:41.569924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:41.569945 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:41.570055 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.570071 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.571062 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.571065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.572226 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:41.572239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.573241 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.573244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:41.573349 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.573373 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:22:41.573476 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:22:41.573555 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4234,"thread_start_us":127,"threads_started":1}
I20260812 11:22:41.573726 3485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.553368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:39453 (local address 127.12.175.194:45565)
0812 11:22:41.553518 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.553522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.563310 (+ 9788us) server_negotiation.cc:407] Connection header received
0812 11:22:41.563379 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.563382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.563435 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.563522 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:41.570207 (+ 6685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.570922 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.572391 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.572997 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.573093 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.573142 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.573527 (+ 385us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.573612 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:22:41.574455 3117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e160059db1a446038e0e6b015d00d594" candidate_uuid: "b3c3c4e04de1464b841968724cacf58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97142026aa2d418e8885f7099a97b62d" is_pre_election: true
I20260812 11:22:41.574774 3117 raft_consensus.cc:2454] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3c3c4e04de1464b841968724cacf58d in term 0.
I20260812 11:22:41.575132 3083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e160059db1a446038e0e6b015d00d594" candidate_uuid: "b3c3c4e04de1464b841968724cacf58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97142026aa2d418e8885f7099a97b62d"
I20260812 11:22:41.574834 2519 catalog_manager.cc:5495] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b3c3c4e04de1464b841968724cacf58d (127.12.175.193). New cstate: current_term: 1 leader_uuid: "b3c3c4e04de1464b841968724cacf58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3c3c4e04de1464b841968724cacf58d" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 39737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260812 11:22:41.575244 3083 raft_consensus.cc:3037] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:41.576511 3083 raft_consensus.cc:2454] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3c3c4e04de1464b841968724cacf58d in term 1.
W20260812 11:22:41.625572 2944 tablet.cc:2369] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:41.630457 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.625370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41292 (local address 127.12.175.193:39737)
0812 11:22:41.625501 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:41.625506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:41.625519 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:22:41.625589 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:41.625591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:41.625654 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:41.625746 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:41.626352 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.627142 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.628412 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:41.628755 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:41.628851 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:41.629264 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:41.629753 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:41.629862 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:41.630274 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 11:22:41.630333 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:22:41.639662 3332 raft_consensus.cc:1261] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 1 FOLLOWER]: Refusing update from remote peer b3c3c4e04de1464b841968724cacf58d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:41.640514 3520 consensus_queue.cc:1035] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14fb8ae86704d4c8a7e6f25f2721877" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:41.647372 3083 raft_consensus.cc:1261] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 1 FOLLOWER]: Refusing update from remote peer b3c3c4e04de1464b841968724cacf58d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:41.648106 3520 consensus_queue.cc:1035] T e160059db1a446038e0e6b015d00d594 P b3c3c4e04de1464b841968724cacf58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97142026aa2d418e8885f7099a97b62d" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:41.664222 3525 mvcc.cc:205] Tried to move back new op lower bound from 7317642287666929664 to 7317642287400275968. Current Snapshot: MvccSnapshot[applied={T|T < 7317642287666929664}]
I20260812 11:22:41.664450 3526 mvcc.cc:205] Tried to move back new op lower bound from 7317642287666929664 to 7317642287400275968. Current Snapshot: MvccSnapshot[applied={T|T < 7317642287666929664}]
I20260812 11:22:41.667330 3531 mvcc.cc:205] Tried to move back new op lower bound from 7317642287666929664 to 7317642287400275968. Current Snapshot: MvccSnapshot[applied={T|T < 7317642287666929664}]
I20260812 11:22:41.677955 2518 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:41.678118 2518 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:41.680737 2518 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03682042aa784cb69f81625abd3120a9: Sending DeleteTablet for 3 replicas of tablet e160059db1a446038e0e6b015d00d594
I20260812 11:22:41.681629 2821 tablet_service.cc:1514] Processing DeleteTablet for tablet e160059db1a446038e0e6b015d00d594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:41 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:41280
I20260812 11:22:41.681842 3303 tablet_service.cc:1514] Processing DeleteTablet for tablet e160059db1a446038e0e6b015d00d594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:41 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:33338
I20260812 11:22:41.682268 3067 tablet_service.cc:1514] Processing DeleteTablet for tablet e160059db1a446038e0e6b015d00d594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:41 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:39064
I20260812 11:22:41.683372 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 2683
I20260812 11:22:41.695449 3555 tablet_replica.cc:330] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: stopping tablet replica
I20260812 11:22:41.695724 3555 raft_consensus.cc:2229] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:41.695981 3555 raft_consensus.cc:2258] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:41.701181 3555 ts_tablet_manager.cc:1905] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:41.704485 3555 ts_tablet_manager.cc:1918] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:41.704614 3555 log.cc:1196] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/e160059db1a446038e0e6b015d00d594
I20260812 11:22:41.705029 3555 ts_tablet_manager.cc:1939] T e160059db1a446038e0e6b015d00d594 P b14fb8ae86704d4c8a7e6f25f2721877: Deleting consensus metadata
I20260812 11:22:41.706604 2495 catalog_manager.cc:4841] TS b14fb8ae86704d4c8a7e6f25f2721877 (127.12.175.195:40863): tablet e160059db1a446038e0e6b015d00d594 (table test-table [id=73cf27b6685b4756bb09cc7833e5b7a2]) successfully deleted
I20260812 11:22:41.709717 3556 tablet_replica.cc:330] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: stopping tablet replica
I20260812 11:22:41.710083 3556 raft_consensus.cc:2229] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:41.710425 3556 raft_consensus.cc:2258] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:41.719590 3556 ts_tablet_manager.cc:1905] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:41.723307 3556 ts_tablet_manager.cc:1918] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:41.723462 3556 log.cc:1196] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/e160059db1a446038e0e6b015d00d594
I20260812 11:22:41.723845 3556 ts_tablet_manager.cc:1939] T e160059db1a446038e0e6b015d00d594 P 97142026aa2d418e8885f7099a97b62d: Deleting consensus metadata
W20260812 11:22:41.724772 2495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:39737 (error 108)
I20260812 11:22:41.725114 2494 catalog_manager.cc:4841] TS 97142026aa2d418e8885f7099a97b62d (127.12.175.194:45565): tablet e160059db1a446038e0e6b015d00d594 (table test-table [id=73cf27b6685b4756bb09cc7833e5b7a2]) successfully deleted
I20260812 11:22:41.725804 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 2953
I20260812 11:22:41.726446 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:41.725767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:39737 (local address 127.0.0.1:41298)
0812 11:22:41.726293 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:41.726356 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:39737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448}
W20260812 11:22:41.730427 2495 catalog_manager.cc:4584] TS b3c3c4e04de1464b841968724cacf58d (127.12.175.193:39737): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e160059db1a446038e0e6b015d00d594: Network error: Client connection negotiation failed: client connection to 127.12.175.193:39737: connect: Connection refused (error 111)
I20260812 11:22:41.737327 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 3203
I20260812 11:22:41.766355 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 2461
I20260812 11:22:41.781831 12991 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:22:42.126398 12991 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:22:42.126528 12991 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:22:42.480746 12991 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:22:42.480 UTC [1635] LOG: received smart shutdown request
2026-08-12 11:22:42.484 UTC [1635] LOG: background worker "logical replication launcher" (PID 1659) exited with exit code 1
2026-08-12 11:22:42.485 UTC [1647] LOG: shutting down
2026-08-12 11:22:42.618 UTC [1635] LOG: database system is shut down
2026-08-12T11:22:42Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45431 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:42 dist-test-slave-gjrz krb5kdc[3587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:42 dist-test-slave-gjrz krb5kdc[3587](info): set up 2 sockets
Aug 12 11:22:42 dist-test-slave-gjrz krb5kdc[3587](info): commencing operation
krb5kdc: starting...
W20260812 11:22:43.919085 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:22:43 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:44Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/rangeradmin_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/rangeradmin_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/rangerlookup_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/rangerlookup_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
I20260812 11:22:44.076175 12991 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNqPwv8/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/postgres -l logfile start
2026-08-12 11:22:46.353 UTC [3646] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:22:46.353 UTC [3646] LOG: listening on IPv4 address "127.12.175.212", port 56569
2026-08-12 11:22:46.356 UTC [3646] LOG: listening on Unix socket "/tmp/.s.PGSQL.56569"
2026-08-12 11:22:46.376 UTC [3653] LOG: database system was shut down at 2026-08-12 11:22:45 UTC
2026-08-12 11:22:46.379 UTC [3646] LOG: database system is ready to accept connections
I20260812 11:22:47.498800 12991 mini_postgres.cc:96] Postgres bound to 56569
2026-08-12 11:22:47.505 UTC [3681] FATAL: database "slave" does not exist
127.12.175.212:56569 - accepting connections
I20260812 11:22:47.506395 12991 mini_ranger.cc:161] Starting Ranger...
I20260812 11:22:47.520687 12991 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:22:47.955856 12991 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:22:47.955933 12991 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-admin
2026-08-12 11:22:48,227 [I] DB FLAVOR :POSTGRES
2026-08-12 11:22:48,228 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:22:48,228 [I] Checking connection..
2026-08-12 11:22:48,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:22:48,477 [I] Checking connection passed.
2026-08-12 11:22:48,478 [I] --------- Verifying version history table ---------
2026-08-12 11:22:48,478 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:22:48,722 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:22:48,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:22:48,977 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:22:48,978 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:22:48,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:22:49.202 UTC [3805] WARNING: there is no transaction in progress
2026-08-12 11:22:49,210 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:22:49,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:22:49,454 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:22:49,455 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:22:49,455 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:22:49,686 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:22:49,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-12 11:22:50,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:22:50,415 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:22:50,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:22:50,666 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:22:50,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:22:50,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:22:51,160 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:22:51,160 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:22:52.068 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.083 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.098 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.111 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.128 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.147 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.201 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.207 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.221 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.230 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.239 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.252 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.261 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.267 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.273 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52.279 UTC [4020] WARNING: there is no transaction in progress
2026-08-12 11:22:52,859 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:22:52,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:22:53,095 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:22:53,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:22:53,326 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:22:53,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:22:53,571 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:22:53,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:22:53,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:22:54,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-12 11:22:54,278 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:22:54,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:22:54,527 [I] DB_PATCHES have already been applied
I20260812 11:22:54.532702 12991 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNqPwv8/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:22:54.532763 12991 mini_ranger.cc:193] Using host: 127.12.175.212
I20260812 11:22:54.536832 12991 mini_ranger.cc:227] Ranger admin URL: http://127.12.175.212:37671
Aug 12, 2026 11:22:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:22:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:22:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:22:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:22:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:22:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:22:55 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:22:55.850307 12991 mini_ranger.cc:160] Time spent starting Ranger: real 8.344s user 0.001s sys 0.009s
Aug 12, 2026 11:23:13 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:23:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 11:23:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:23:13 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:23:14 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:23:15.243520 12991 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/rangerkms_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/rangerkms_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.175.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.175.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.175.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/HTTP_127.12.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:23:15 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533795, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:23:15.337936 12991 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:23:15.347770 12991 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:23:16.090770 12991 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:23:16.090842 12991 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms
I20260812 11:23:16.090854 12991 mini_ranger_kms.cc:227] Using postgres at 127.12.175.212:56569
2026-08-12 11:23:16,249 [I] DB FLAVOR :POSTGRES
2026-08-12 11:23:16,250 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:23:16,250 [I] Checking connection
2026-08-12 11:23:16,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:23:16,503 [I] connection success
2026-08-12 11:23:16,504 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:23:16,504 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:23:16,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:23:16,745 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:23:16,746 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:23:16,746 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:23:16,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.175.212:56569/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:23:17,019 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:23:17.466065 12991 mini_ranger_kms.cc:310] Created kms service
I20260812 11:23:17.636613 12991 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:23:17.675722 12991 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:23:17 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533795, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:18.037153 12991 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:23:18.037297 12991 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNqPwv8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNqPwv8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:23:18.037317 12991 mini_ranger_kms.cc:240] Using host: 127.12.175.212
I20260812 11:23:18.042395 12991 mini_ranger_kms.cc:276] Ranger KMS PID: 4372
I20260812 11:23:18.042464 12991 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.175.212:40763
Aug 12, 2026 11:23:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:23:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:23:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:23:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:23:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:23:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:23:20 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533800, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.175.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:20.639403 12991 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.301s user 0.016s sys 0.128s
I20260812 11:23:20.639519 12991 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:23:20.639585 12991 mini_ranger_kms.cc:401] 127.12.175.212:40763/kms/v1/keys
Aug 12 11:23:20 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533800, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.175.212@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
Aug 12 11:23:21 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533800, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.175.212@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
Aug 12 11:23:23 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:23:23.411703 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39243
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39243
--ranger_config_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:23.520516 4473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:23.520730 4473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:23.520766 4473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:23.524664 4473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:23.524712 4473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:23.524730 4473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:23.524744 4473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:23.524758 4473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:23.529906 4473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.175.212:40763/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39243
--ranger_config_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:23.530790 4473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:23.531733 4473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:23.539837 4479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:23.539958 4481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:23.540071 4473 server_base.cc:1034] running on GCE node
W20260812 11:23:23.540254 4485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:23.540756 4473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:23.541733 4473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:23.542886 4473 hybrid_clock.cc:648] HybridClock initialized: now 1786533803542859 us; error 44 us; skew 500 ppm
Aug 12 11:23:23 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533803, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:23.550125 4473 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:23.550967 4473 webserver.cc:460] Webserver started at http://127.12.175.254:45017/ using document root <none> and password file <none>
I20260812 11:23:23.551491 4473 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:23.551546 4473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:23.551724 4473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:23:23 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533803, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:23.614531 4473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "447a187c01614b328646487b5928f81a"
format_stamp: "Formatted at 2026-08-12 11:23:23 on dist-test-slave-gjrz"
server_key: "66a44e9aeb8845184bcd7f91a5414d16"
server_key_iv: "0e7d215faac1993bc5f2cd01f76832ec"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:23.615128 4473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "447a187c01614b328646487b5928f81a"
format_stamp: "Formatted at 2026-08-12 11:23:23 on dist-test-slave-gjrz"
server_key: "66a44e9aeb8845184bcd7f91a5414d16"
server_key_iv: "0e7d215faac1993bc5f2cd01f76832ec"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:23.618893 4473 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:23:23.631847 4494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:23.633095 4473 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:23:23.633203 4473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "447a187c01614b328646487b5928f81a"
format_stamp: "Formatted at 2026-08-12 11:23:23 on dist-test-slave-gjrz"
server_key: "66a44e9aeb8845184bcd7f91a5414d16"
server_key_iv: "0e7d215faac1993bc5f2cd01f76832ec"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:23.633314 4473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:23.651670 4473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:23.654256 4473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:23.654410 4473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:23.661602 4473 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39243
I20260812 11:23:23.661653 4596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39243 every 8 connection(s)
I20260812 11:23:23.662518 4473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:23.665915 4597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:23.668016 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 4473
I20260812 11:23:23.668146 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:23:23.668416 12991 external_mini_cluster.cc:1428] Setting key 4c8e64b0c1a26f3261e755bb8f6b673c
I20260812 11:23:23.673100 4597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Bootstrap starting.
I20260812 11:23:23.675740 4597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Neither blocks nor log segments found. Creating new log.
Aug 12 11:23:23 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:23.676600 4597 log.cc:824] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:23.678509 4597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: No bootstrap required, opened a new log
I20260812 11:23:23.681828 4597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:23.682090 4597 raft_consensus.cc:374] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:23.682165 4597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447a187c01614b328646487b5928f81a, State: Initialized, Role: FOLLOWER
I20260812 11:23:23.682590 4597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:23.682723 4597 raft_consensus.cc:388] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:23.682839 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:23.669757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49722 (local address 127.12.175.254:39243)
0812 11:23:23.670152 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:23.670168 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:23.670201 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:23:23.670831 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:23.670849 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:23.671156 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:23.671501 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:23.672271 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:23.673263 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:23.674133 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:23.674597 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:23.674741 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:23.677164 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:23.677171 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:23.677187 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:23.677216 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:23.679702 (+ 2486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:23.680252 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:23.680258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:23.680264 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:23.680392 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:23.680685 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:23.680688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:23.680690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:23.681159 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:23.681359 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:23.681647 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 11:23:23.681934 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":118,"threads_started":1}
I20260812 11:23:23.682807 4597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:23.683061 4597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:23.683957 4597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:23.684327 4597 leader_election.cc:302] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 447a187c01614b328646487b5928f81a; no voters:
I20260812 11:23:23.684640 4597 leader_election.cc:288] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:23:23.684788 4613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:23.685052 4613 raft_consensus.cc:686] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 LEADER]: Becoming Leader. State: Replica: 447a187c01614b328646487b5928f81a, State: Running, Role: LEADER
I20260812 11:23:23.685406 4613 consensus_queue.cc:237] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:23.685784 4597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:23.686638 4613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "447a187c01614b328646487b5928f81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } } }
I20260812 11:23:23.686784 4613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:23.687005 4613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 447a187c01614b328646487b5928f81a. Latest consensus state: current_term: 1 leader_uuid: "447a187c01614b328646487b5928f81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } } }
I20260812 11:23:23.687142 4613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:23.687171 4634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:23.690548 4634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:23.690924 4597 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:23:23.701745 4634 catalog_manager.cc:1347] Generated new cluster ID: 1ab73bfe7b5047f5a60de19e0f412e0f
I20260812 11:23:23.701920 4634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:23.715216 4634 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:23.716387 4634 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:23.726467 4634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Generated new TSK 0
I20260812 11:23:23.727317 4634 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:23:24.380584 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39243
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:24.493710 4699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:24.493927 4699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:24.493983 4699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:24.497953 4699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:24.498005 4699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:24.498077 4699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:23:24.503885 4699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.175.212:40763/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:24.505148 4699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:24.506389 4699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:24.515681 4717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:24.515672 4711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:24.515878 4699 server_base.cc:1034] running on GCE node
W20260812 11:23:24.516176 4708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:24.516552 4699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:24.517120 4699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:24.518271 4699 hybrid_clock.cc:648] HybridClock initialized: now 1786533804518239 us; error 51 us; skew 500 ppm
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:24.520969 4699 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:23:24.521813 4699 webserver.cc:460] Webserver started at http://127.12.175.193:34247/ using document root <none> and password file <none>
I20260812 11:23:24.522323 4699 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:24.522382 4699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:24.522567 4699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:24.538614 4699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "98d583603403446c847e3669ee439d62"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "1459b2edf4833e47bc71bbfb623a91c5"
server_key_iv: "e7df50f3b1e06600c95eec4ce30d1acf"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:24.539348 4699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "98d583603403446c847e3669ee439d62"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "1459b2edf4833e47bc71bbfb623a91c5"
server_key_iv: "e7df50f3b1e06600c95eec4ce30d1acf"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:24.544348 4699 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260812 11:23:24.563620 4733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:24.565286 4699 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260812 11:23:24.565469 4699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "98d583603403446c847e3669ee439d62"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "1459b2edf4833e47bc71bbfb623a91c5"
server_key_iv: "e7df50f3b1e06600c95eec4ce30d1acf"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:24.565616 4699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:24.603338 4699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:24.605973 4699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:24.606139 4699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:24.606719 4699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:24.607556 4699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:24.607607 4699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:24.607658 4699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:24.607712 4699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:24.617780 4699 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:41027
I20260812 11:23:24.618851 4699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:23:24.624394 4960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:41027 every 8 connection(s)
I20260812 11:23:24.626451 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 4699
I20260812 11:23:24.626567 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:23:24.626869 12991 external_mini_cluster.cc:1428] Setting key 3e7398c7dea9146d965b91d14810bbef
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:24.642692 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:24.627290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39243 (local address 127.12.175.193:39811)
0812 11:23:24.628389 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:24.628442 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:24.629584 (+ 1142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:24.630372 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:24.630381 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:24.630723 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:24.631401 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:24.631423 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.632602 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.632606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:24.633944 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:24.633956 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.634730 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.634734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:24.634922 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:24.635603 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:24.635624 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:24.637360 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:24.639602 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:24.639608 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:24.639622 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:24.639958 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:24.640315 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:24.640318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:24.640320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:24.640494 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:24.640979 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:24.640986 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:24.641265 (+ 279us) client_negotiation.cc:769] Sending connection context
0812 11:23:24.641439 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 11:23:24.641739 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":140,"threads_started":1}
I20260812 11:23:24.643471 4965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:24.626879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:39811 (local address 127.12.175.254:39243)
0812 11:23:24.627215 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:24.627224 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:24.629052 (+ 1828us) server_negotiation.cc:407] Connection header received
0812 11:23:24.629901 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:24.629905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:24.629960 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:24.630042 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:24.631581 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.632446 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.634103 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.634464 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.634563 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:24.637558 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:24.637562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:24.637565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:24.637591 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:24.639467 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:24.640092 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:24.640095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:24.640097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:24.640200 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:24.640619 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:24.640622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:24.640624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:24.640841 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:24.643059 (+ 2218us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:24.643153 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 11:23:24.643296 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":103,"threads_started":1}
I20260812 11:23:24.644531 4961 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39243
I20260812 11:23:24.644769 4961 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:24.645352 4961 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:23:24.647146 4531 ts_manager.cc:194] Registered new tserver with Master: 98d583603403446c847e3669ee439d62 (127.12.175.193:41027)
I20260812 11:23:24.648684 4531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:39811
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:23:24.677585 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39243
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:23:24.800418 4977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:24.800642 4977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:24.800698 4977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:24.804694 4977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:24.804746 4977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:24.804821 4977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:23:24.811203 4977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.175.212:40763/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:24.812127 4977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:24.813159 4977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:24.822574 4989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:24.822525 4992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:24.822712 4994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:24.822896 4977 server_base.cc:1034] running on GCE node
I20260812 11:23:24.823454 4977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:24.824040 4977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:24.825269 4977 hybrid_clock.cc:648] HybridClock initialized: now 1786533804825244 us; error 42 us; skew 500 ppm
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:24.830364 4977 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:23:24.831396 4977 webserver.cc:460] Webserver started at http://127.12.175.194:45991/ using document root <none> and password file <none>
I20260812 11:23:24.831966 4977 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:24.832049 4977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:24.832274 4977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:24.844693 4977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "8f27319cd88d4c299a14c7214efc3d16"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "03044ce94d0820f359fa64e070f578c0"
server_key_iv: "c742e6cd8a415f34d062a305aa35f41c"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:24.845378 4977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "8f27319cd88d4c299a14c7214efc3d16"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "03044ce94d0820f359fa64e070f578c0"
server_key_iv: "c742e6cd8a415f34d062a305aa35f41c"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:24.850699 4977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:23:24.871920 5005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:24.873674 4977 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260812 11:23:24.873804 4977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "8f27319cd88d4c299a14c7214efc3d16"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "03044ce94d0820f359fa64e070f578c0"
server_key_iv: "c742e6cd8a415f34d062a305aa35f41c"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:24.873929 4977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:24.890414 4977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:24.893308 4977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:24.893473 4977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:24.894043 4977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:24.894878 4977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:24.894940 4977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:24.895041 4977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:24.895069 4977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:24.905341 4977 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:36975
I20260812 11:23:24.905519 5211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:36975 every 8 connection(s)
I20260812 11:23:24.906263 4977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:23:24.908242 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 4977
I20260812 11:23:24.908367 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:23:24.908679 12991 external_mini_cluster.cc:1428] Setting key 292e66c367220ad973d04eca5adf52ea
Aug 12 11:23:24 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:24.924724 4965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:24.909449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:38699 (local address 127.12.175.254:39243)
0812 11:23:24.909597 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:24.909602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:24.913468 (+ 3866us) server_negotiation.cc:407] Connection header received
0812 11:23:24.914320 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:24.914323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:24.914373 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:24.914444 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:24.915733 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.916266 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.917783 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.918140 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.918225 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:24.921171 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:24.921176 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:24.921178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:24.921204 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:24.922803 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:24.923302 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:24.923306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:24.923307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:24.923383 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:24.923708 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:24.923711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:24.923712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:24.923880 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:24.923965 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:24.924444 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 11:23:24.924566 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:23:24.925549 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:24.908694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39243 (local address 127.12.175.194:38699)
0812 11:23:24.913325 (+ 4631us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:24.913365 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:24.914129 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:24.914622 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:24.914631 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:24.915034 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:24.915593 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:24.915609 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.916386 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.916389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:24.917634 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:24.917648 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:24.918439 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:24.918444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:24.918637 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:24.919250 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:24.919296 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:24.920985 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:24.922923 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:24.922929 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:24.922942 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:24.923174 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:24.923475 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:24.923478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:24.923480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:24.923608 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:24.923980 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:24.923988 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:24.924207 (+ 219us) client_negotiation.cc:769] Sending connection context
0812 11:23:24.924358 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 11:23:24.924635 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4442,"thread_start_us":154,"threads_started":1}
I20260812 11:23:24.926735 5213 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39243
I20260812 11:23:24.926959 5213 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:24.927459 5213 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:24.928574 4531 ts_manager.cc:194] Registered new tserver with Master: 8f27319cd88d4c299a14c7214efc3d16 (127.12.175.194:36975)
I20260812 11:23:24.929160 4531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:38699
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:23:24.949801 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39243
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:25.096814 5226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:25.097170 5226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:25.097239 5226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:25.103224 5226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:25.103356 5226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:25.103457 5226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:23:25.110822 5226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.175.212:40763/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:25.112082 5226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:25.113431 5226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:25.125226 5236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.125344 5239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.125234 5235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:25.126255 5226 server_base.cc:1034] running on GCE node
I20260812 11:23:25.126698 5226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:25.127477 5226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:25.128641 5226 hybrid_clock.cc:648] HybridClock initialized: now 1786533805128581 us; error 74 us; skew 500 ppm
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:25.132061 5226 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:23:25.133021 5226 webserver.cc:460] Webserver started at http://127.12.175.195:41795/ using document root <none> and password file <none>
I20260812 11:23:25.133651 5226 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:25.133715 5226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:25.133921 5226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:25.154510 5226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "8d259ed8b0a043fbb2b517e7d2890057"
format_stamp: "Formatted at 2026-08-12 11:23:25 on dist-test-slave-gjrz"
server_key: "1e3bfda4780377125431af56881df9b6"
server_key_iv: "26277296a7b37939cd1961663da4633f"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:25.155247 5226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "8d259ed8b0a043fbb2b517e7d2890057"
format_stamp: "Formatted at 2026-08-12 11:23:25 on dist-test-slave-gjrz"
server_key: "1e3bfda4780377125431af56881df9b6"
server_key_iv: "26277296a7b37939cd1961663da4633f"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:25.168692 5226 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.003s sys 0.001s
I20260812 11:23:25.187680 5250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:25.189342 5226 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260812 11:23:25.189466 5226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "8d259ed8b0a043fbb2b517e7d2890057"
format_stamp: "Formatted at 2026-08-12 11:23:25 on dist-test-slave-gjrz"
server_key: "1e3bfda4780377125431af56881df9b6"
server_key_iv: "26277296a7b37939cd1961663da4633f"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:25.189590 5226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533804, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:25.239921 5226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:25.243286 5226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:25.243465 5226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:25.244118 5226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:25.245119 5226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:25.245180 5226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:25.245230 5226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:25.245296 5226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 11:23:25.255671 5226 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:33567
I20260812 11:23:25.256722 5226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:23:25.265717 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 5226
I20260812 11:23:25.265832 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:23:25.266191 12991 external_mini_cluster.cc:1428] Setting key 3411d78e52295d387e1b857ca237d39c
I20260812 11:23:25.268348 5472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:33567 every 8 connection(s)
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:25.286082 4965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:25.258906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:60505 (local address 127.12.175.254:39243)
0812 11:23:25.259055 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:25.259059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:25.271749 (+ 12690us) server_negotiation.cc:407] Connection header received
0812 11:23:25.273328 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:25.273332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:25.273387 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:25.273437 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:25.275052 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.275903 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.277588 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.277920 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.278052 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:25.281975 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:25.281979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:25.281982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:25.282021 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:25.283722 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:25.284325 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:25.284329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:25.284331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:25.284421 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:25.284795 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:25.284798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:25.284800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:25.285023 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:25.285100 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:25.285751 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 11:23:25.285884 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:23:25.287914 5478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:25.259180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39243 (local address 127.12.175.195:60505)
0812 11:23:25.271592 (+ 12412us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:25.271651 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:25.273079 (+ 1428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:25.273859 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:25.273868 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:25.274229 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:25.274873 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:25.274892 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.276070 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.276074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:25.277448 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:25.277459 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.278084 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.278088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:25.278288 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:25.279497 (+ 1209us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:25.279518 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:25.281768 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:25.283859 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:25.283865 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:25.283881 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:25.284210 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:25.284527 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:25.284530 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:25.284532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:25.284693 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:25.285181 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:25.285187 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:25.285480 (+ 293us) client_negotiation.cc:769] Sending connection context
0812 11:23:25.286493 (+ 1013us) client_negotiation.cc:240] Negotiation successful
0812 11:23:25.286860 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12167,"thread_start_us":145,"threads_started":1}
I20260812 11:23:25.289306 5476 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39243
I20260812 11:23:25.289587 5476 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:25.290177 5476 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:25.292577 4531 ts_manager.cc:194] Registered new tserver with Master: 8d259ed8b0a043fbb2b517e7d2890057 (127.12.175.195:33567)
I20260812 11:23:25.293289 4531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:60505
I20260812 11:23:25.302850 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:23:25.303650 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 4699
I20260812 11:23:25.333284 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 4977
I20260812 11:23:25.342665 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 5226
I20260812 11:23:25.354342 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 4473
I20260812 11:23:25.367093 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39243
--webserver_interface=127.12.175.254
--webserver_port=45017
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39243
--ranger_config_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:25.471841 5480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:25.472052 5480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:25.472096 5480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:25.475982 5480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:25.476032 5480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:25.476052 5480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:25.476082 5480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:25.476109 5480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:25.481184 5480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39243
--ranger_config_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=45017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:25.482055 5480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:25.482906 5480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:25.490680 5495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.490693 5497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.490686 5489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:25.491518 5480 server_base.cc:1034] running on GCE node
I20260812 11:23:25.492102 5480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:25.493271 5480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:25.494448 5480 hybrid_clock.cc:648] HybridClock initialized: now 1786533805494426 us; error 39 us; skew 500 ppm
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:25.497531 5480 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:25.498306 5480 webserver.cc:460] Webserver started at http://127.12.175.254:45017/ using document root <none> and password file <none>
I20260812 11:23:25.498773 5480 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:25.498840 5480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:25.525370 5480 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:23:25.527788 5512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:25.528935 5480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:23:25.529042 5480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "447a187c01614b328646487b5928f81a"
format_stamp: "Formatted at 2026-08-12 11:23:23 on dist-test-slave-gjrz"
server_key: "66a44e9aeb8845184bcd7f91a5414d16"
server_key_iv: "0e7d215faac1993bc5f2cd01f76832ec"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:25.529553 5480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:25.539723 5480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:25.541888 5480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:25.542047 5480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:25.548715 5480 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39243
I20260812 11:23:25.548730 5607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39243 every 8 connection(s)
I20260812 11:23:25.549731 5480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:25.553282 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 5480
I20260812 11:23:25.553675 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:41027
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:39243
--webserver_port=34247
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:25.553719 5608 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:23:25.555226 5608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Bootstrap starting.
I20260812 11:23:25.570694 5608 log.cc:824] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:25.576633 5608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:23:25.576948 5608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Bootstrap complete.
I20260812 11:23:25.580731 5608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:25.581076 5608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447a187c01614b328646487b5928f81a, State: Initialized, Role: FOLLOWER
I20260812 11:23:25.581509 5608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:25.581627 5608 raft_consensus.cc:388] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:25.581687 5608 raft_consensus.cc:482] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:25.581779 5608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:23:25.583561 5608 raft_consensus.cc:504] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:25.583853 5608 leader_election.cc:302] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 447a187c01614b328646487b5928f81a; no voters:
I20260812 11:23:25.584113 5608 leader_election.cc:288] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:23:25.584197 5614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:23:25.584432 5614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [term 2 LEADER]: Becoming Leader. State: Replica: 447a187c01614b328646487b5928f81a, State: Running, Role: LEADER
I20260812 11:23:25.584759 5614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } }
I20260812 11:23:25.585273 5608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:25.585976 5616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "447a187c01614b328646487b5928f81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } } }
I20260812 11:23:25.586118 5616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:25.586319 5616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 447a187c01614b328646487b5928f81a. Latest consensus state: current_term: 2 leader_uuid: "447a187c01614b328646487b5928f81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "447a187c01614b328646487b5928f81a" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39243 } } }
I20260812 11:23:25.586400 5616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:25.587368 5627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:25.587472 5608 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:23:25.593230 5627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:25.594058 5627 catalog_manager.cc:1259] Loaded cluster ID: 1ab73bfe7b5047f5a60de19e0f412e0f
I20260812 11:23:25.594154 5627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:25.596724 5627 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:25.597432 5627 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Loaded TSK: 0
I20260812 11:23:25.598664 5627 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:23:25.666930 5611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:25.667150 5611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:25.667189 5611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:25.671170 5611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:25.671224 5611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:25.671317 5611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:23:25.676775 5611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:41027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=34247
--tserver_master_addrs=127.12.175.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:25.677814 5611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:25.678941 5611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:25.688499 5684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.688486 5682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.689218 5681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:25.689409 5611 server_base.cc:1034] running on GCE node
I20260812 11:23:25.689881 5611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:25.690455 5611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:25.691632 5611 hybrid_clock.cc:648] HybridClock initialized: now 1786533805691605 us; error 33 us; skew 500 ppm
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:25.695125 5611 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:23:25.696259 5611 webserver.cc:460] Webserver started at http://127.12.175.193:34247/ using document root <none> and password file <none>
I20260812 11:23:25.696987 5611 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:25.697139 5611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:25.740559 5611 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:23:25.744094 5699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:25.748080 5611 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260812 11:23:25.748262 5611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "98d583603403446c847e3669ee439d62"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "1459b2edf4833e47bc71bbfb623a91c5"
server_key_iv: "e7df50f3b1e06600c95eec4ce30d1acf"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:25.749075 5611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:25.785009 5611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:25.788493 5611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:25.788700 5611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:25.789438 5611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:25.790486 5611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:25.790563 5611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:25.790678 5611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:25.790717 5611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:25.801952 5611 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:41027
I20260812 11:23:25.802004 5936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:41027 every 8 connection(s)
I20260812 11:23:25.803005 5611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:23:25.803793 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 5611
I20260812 11:23:25.804277 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:36975
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:39243
--webserver_port=45991
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:25.824445 5942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:25.806579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39243 (local address 127.12.175.193:56949)
0812 11:23:25.808661 (+ 2082us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:25.808717 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:25.809714 (+ 997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:25.811565 (+ 1851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:25.811575 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:25.811899 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:25.812526 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:25.812549 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.814425 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.814429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:25.815662 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:25.815673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.816466 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.816471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:25.816648 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:25.817166 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:25.817180 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:25.818466 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:25.820870 (+ 2404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:25.820876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:25.820891 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:25.821237 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:25.821692 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:25.821696 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:25.821698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:25.821874 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:25.822690 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:25.822696 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:25.822967 (+ 271us) client_negotiation.cc:769] Sending connection context
0812 11:23:25.823151 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 11:23:25.823485 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1874,"thread_start_us":145,"threads_started":1}
I20260812 11:23:25.824707 5944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:25.808025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:56949 (local address 127.12.175.254:39243)
0812 11:23:25.810206 (+ 2181us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:25.810227 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:25.810267 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:23:25.810552 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:25.810566 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:25.810950 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:25.811311 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:25.812718 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.814271 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.815783 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:25.816318 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:25.816468 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:25.818665 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:25.818671 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:25.818684 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:25.818716 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:25.820725 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:25.821392 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:25.821398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:25.821403 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:25.821568 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:25.822009 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:25.822012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:25.822014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:25.822483 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:25.822630 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:25.823497 (+ 867us) server_negotiation.cc:299] Negotiation successful
0812 11:23:25.823784 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2025,"thread_start_us":116,"threads_started":1}
I20260812 11:23:25.827983 5937 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39243
I20260812 11:23:25.828222 5937 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:25.828745 5937 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
W20260812 11:23:25.830884 5937 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:39243 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:23:25.830991 5937 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:25.831144 5937 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:25.832008 5937 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:25.832172 5937 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
W20260812 11:23:25.832921 5937 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:23:25.964594 5941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:25.964890 5941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:25.964949 5941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:25.970768 5941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:25.970839 5941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:25.970921 5941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:23:25.976462 5941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:36975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=45991
--tserver_master_addrs=127.12.175.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:25.977421 5941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:25.978336 5941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:25.988797 5961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.988996 5952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:25.989195 5953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:25.989465 5941 server_base.cc:1034] running on GCE node
I20260812 11:23:25.989825 5941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:25.990381 5941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:25.991530 5941 hybrid_clock.cc:648] HybridClock initialized: now 1786533805991499 us; error 53 us; skew 500 ppm
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:25.994197 5941 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:23:25.995018 5941 webserver.cc:460] Webserver started at http://127.12.175.194:45991/ using document root <none> and password file <none>
I20260812 11:23:25.995649 5941 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:25.995736 5941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:23:25 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:26.020484 5941 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.000s sys 0.003s
I20260812 11:23:26.023584 5978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:26.025133 5941 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260812 11:23:26.025261 5941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "8f27319cd88d4c299a14c7214efc3d16"
format_stamp: "Formatted at 2026-08-12 11:23:24 on dist-test-slave-gjrz"
server_key: "03044ce94d0820f359fa64e070f578c0"
server_key_iv: "c742e6cd8a415f34d062a305aa35f41c"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:26.025955 5941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:26.059576 5941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:26.062714 5941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:26.062896 5941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:26.063493 5941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:26.064350 5941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:26.064399 5941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:26.064450 5941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:26.064481 5941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:26.074954 5941 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:36975
I20260812 11:23:26.075002 6201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:36975 every 8 connection(s)
I20260812 11:23:26.076213 5941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:23:26.080716 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 5941
I20260812 11:23:26.081233 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.175.212:40763/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:33567
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:39243
--webserver_port=41795
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:45607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:23:26 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533805, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:26.091944 5944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:26.079643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:53617 (local address 127.12.175.254:39243)
0812 11:23:26.079787 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:26.079792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:26.079811 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:23:26.080243 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:26.080246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:26.080304 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:26.080380 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:26.081515 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.082064 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.083280 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.083609 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.083684 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:26.087719 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:26.087723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:26.087726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:26.087754 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:26.089447 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:26.090073 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:26.090077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:26.090079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:26.090169 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:26.090594 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:26.090597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:26.090599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:26.090821 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:26.090897 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:26.091636 (+ 739us) server_negotiation.cc:299] Negotiation successful
0812 11:23:26.091764 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:23:26.093673 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:26.078593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39243 (local address 127.12.175.194:53617)
0812 11:23:26.079064 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:26.079116 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:26.080043 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:26.080566 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:26.080573 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:26.080842 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:26.081344 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:26.081364 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.082198 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.082201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:26.083118 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:26.083130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.083875 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.083878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:26.084088 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:26.084662 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:26.084684 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:26.087561 (+ 2877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:26.089597 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:26.089604 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:26.089619 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:26.089951 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:26.090287 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:26.090289 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:26.090291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:26.090462 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:26.090985 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:26.090991 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:26.091327 (+ 336us) client_negotiation.cc:769] Sending connection context
0812 11:23:26.092362 (+ 1035us) client_negotiation.cc:240] Negotiation successful
0812 11:23:26.092691 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":114,"threads_started":1}
I20260812 11:23:26.095201 6202 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39243
I20260812 11:23:26.095463 6202 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.096024 6202 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
W20260812 11:23:26.104704 6202 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:39243 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:23:26.104820 6202 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.104969 6202 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:26.105782 6202 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.105931 6202 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
W20260812 11:23:26.106680 6202 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:23:26.216979 6206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:26.217212 6206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:26.217267 6206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:26.222040 6206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:26.222148 6206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:26.222249 6206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:23:26.228435 6206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:45607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.175.212:40763/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:33567
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=41795
--tserver_master_addrs=127.12.175.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:26.229584 6206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:26.230827 6206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:26.240542 6213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:26.240542 6217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:26.241346 6206 server_base.cc:1034] running on GCE node
W20260812 11:23:26.243445 6214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:26.243944 6206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:26.244692 6206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:26.252053 6206 hybrid_clock.cc:648] HybridClock initialized: now 1786533806252015 us; error 48 us; skew 500 ppm
Aug 12 11:23:26 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533806, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:26.254902 6206 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:23:26.255992 6206 webserver.cc:460] Webserver started at http://127.12.175.195:41795/ using document root <none> and password file <none>
I20260812 11:23:26.256686 6206 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:26.256791 6206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:23:26 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533806, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:26.278177 6206 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:23:26.281292 6237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:26.282678 6206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:23:26.282835 6206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "8d259ed8b0a043fbb2b517e7d2890057"
format_stamp: "Formatted at 2026-08-12 11:23:25 on dist-test-slave-gjrz"
server_key: "1e3bfda4780377125431af56881df9b6"
server_key_iv: "26277296a7b37939cd1961663da4633f"
server_key_version: "kuduclusterkey@0"
I20260812 11:23:26.284130 6206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:26.310787 6206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:26.314077 6206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:26.314311 6206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:26.315037 6206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:26.316072 6206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:26.316184 6206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:26.316301 6206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:26.316367 6206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:26.330572 6206 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:33567
I20260812 11:23:26.330724 6471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:33567 every 8 connection(s)
I20260812 11:23:26.331843 6206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:23:26.335604 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 6206
Aug 12 11:23:26 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533806, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:26.345371 6476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:26.336653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.12.175.254:39243)
0812 11:23:26.336890 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:26.336894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:26.336907 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:23:26.336946 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:26.336949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:26.336992 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:26.337086 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:26.338021 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.338508 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.339368 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.339606 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.339707 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:26.341278 (+ 1571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:26.341283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:26.341286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:26.341316 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:26.342869 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:26.343548 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:26.343552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:26.343554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:26.343650 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:26.343962 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:26.343965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:26.343967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:26.344187 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:26.344327 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:26.344941 (+ 614us) server_negotiation.cc:299] Negotiation successful
0812 11:23:26.345079 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":87,"threads_started":1}
I20260812 11:23:26.346513 5944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:26.333634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:54713 (local address 127.12.175.254:39243)
0812 11:23:26.333746 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:26.333750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:26.334815 (+ 1065us) server_negotiation.cc:407] Connection header received
0812 11:23:26.335891 (+ 1076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:26.335895 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:26.335953 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:26.336041 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:26.337420 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.337952 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.339628 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.339901 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.339989 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:26.342522 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:26.342526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:26.342538 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:26.342587 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:26.344034 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:26.344602 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:26.344604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:26.344605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:26.344674 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:26.345109 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:26.345112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:26.345113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:26.345322 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:26.345388 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:26.346249 (+ 861us) server_negotiation.cc:299] Negotiation successful
0812 11:23:26.346364 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:23:26.347452 6474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:26.334172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39243 (local address 127.12.175.195:54713)
0812 11:23:26.334674 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:26.334715 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:26.335646 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:26.336271 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:26.336281 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:26.336623 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:26.337285 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:26.337303 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.338074 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.338078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:26.339501 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:26.339514 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:26.340054 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:26.340059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:26.340203 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:26.340676 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:26.340692 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:26.342329 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:26.344146 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:26.344152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:26.344165 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:26.344500 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:26.344774 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:26.344777 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:26.344779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:26.344957 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:26.345480 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:26.345486 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:26.345781 (+ 295us) client_negotiation.cc:769] Sending connection context
0812 11:23:26.346192 (+ 411us) client_negotiation.cc:240] Negotiation successful
0812 11:23:26.346478 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":147,"threads_started":1}
I20260812 11:23:26.348613 6472 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39243
I20260812 11:23:26.348836 6472 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.349298 6472 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
W20260812 11:23:26.350833 6472 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:39243 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:23:26.350955 6472 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.351122 6472 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:26.351985 6472 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.352149 6472 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
W20260812 11:23:26.352890 6472 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 11:23:26 dist-test-slave-gjrz krb5kdc[3587](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533806, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:26.833185 5937 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:26.833468 5937 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:26.834619 5537 ts_manager.cc:194] Registered new tserver with Master: 98d583603403446c847e3669ee439d62 (127.12.175.193:41027)
I20260812 11:23:26.836290 5537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:56949
Aug 12 11:23:27 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533806, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:27.106890 6202 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:27.107216 6202 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:27.110581 5537 ts_manager.cc:194] Registered new tserver with Master: 8f27319cd88d4c299a14c7214efc3d16 (127.12.175.194:36975)
I20260812 11:23:27.111457 5537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:53617
Aug 12 11:23:27 dist-test-slave-gjrz krb5kdc[3587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533806, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for HTTP/127.12.175.212@KRBTEST.COM
I20260812 11:23:27.353111 6472 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:27.353389 6472 heartbeater.cc:511] Master 127.12.175.254:39243 requested a full tablet report, sending...
I20260812 11:23:27.354180 5537 ts_manager.cc:194] Registered new tserver with Master: 8d259ed8b0a043fbb2b517e7d2890057 (127.12.175.195:33567)
I20260812 11:23:27.354811 5537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:54713
I20260812 11:23:27.358613 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:23:27.374745 6516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.363656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49742 (local address 127.12.175.254:39243)
0812 11:23:27.364615 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.364620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.364633 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:23:27.364670 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.364672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.364717 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.365622 (+ 905us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:27.365723 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.366558 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.367805 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.368171 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.368268 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.369947 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:27.369951 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:27.369954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:27.369981 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:27.372624 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:27.373108 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:27.373111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:27.373114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:27.373200 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:27.373476 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:27.373479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:27.373481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:27.373675 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:27.374392 (+ 717us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.374468 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.374589 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":881,"thread_start_us":87,"threads_started":1}
I20260812 11:23:27.378646 5537 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:23:27.384078 5537 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:23:27.415556 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.403614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:41027 (local address 127.0.0.1:51788)
0812 11:23:27.404026 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:27.404070 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:27.404188 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:27.410864 (+ 6676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:27.410867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:27.410884 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:27.410975 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.410981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.412428 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.412431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.413856 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.413868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.415027 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.415031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.415148 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.415192 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:23:27.415296 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:23:27.415409 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":95,"threads_started":1}
I20260812 11:23:27.416584 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.403745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51788 (local address 127.12.175.193:41027)
0812 11:23:27.408368 (+ 4623us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.408376 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.410317 (+ 1941us) server_negotiation.cc:407] Connection header received
0812 11:23:27.410395 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.410401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.410583 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.410723 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:27.411121 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.412292 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.414012 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.414837 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.416177 (+ 1340us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.416310 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.416357 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.416444 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4517,"thread_start_us":113,"threads_started":1}
I20260812 11:23:27.419559 5749 tablet_service.cc:1467] Processing CreateTablet for tablet 5fc2a6e350844688b64e70630cce28e9 (DEFAULT_TABLE table=test-table [id=d7c61dba78f04c4383d3058e2519b319]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:27.420742 5749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fc2a6e350844688b64e70630cce28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:27.421096 6545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.404941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:33567 (local address 127.0.0.1:55476)
0812 11:23:27.412784 (+ 7843us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:27.412798 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:27.412903 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:27.413952 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:27.413956 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:27.413975 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:27.414059 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.414066 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.417775 (+ 3709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.417779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.418837 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.418850 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.420703 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.420707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.420800 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.420825 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:23:27.420895 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:23:27.420958 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7776,"thread_start_us":92,"threads_started":1}
I20260812 11:23:27.421531 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.405593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.12.175.195:33567)
0812 11:23:27.407043 (+ 1450us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.407051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.413017 (+ 5966us) server_negotiation.cc:407] Connection header received
0812 11:23:27.413107 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.413436 (+ 329us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.413640 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.413787 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:27.414197 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.415380 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.418987 (+ 3607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.420402 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.420517 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.420631 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.421307 (+ 676us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.421402 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1343,"thread_start_us":79,"threads_started":1}
I20260812 11:23:27.424268 6345 tablet_service.cc:1467] Processing CreateTablet for tablet 5fc2a6e350844688b64e70630cce28e9 (DEFAULT_TABLE table=test-table [id=d7c61dba78f04c4383d3058e2519b319]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:27.425271 6345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fc2a6e350844688b64e70630cce28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:27.428335 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.404667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36975 (local address 127.0.0.1:42872)
0812 11:23:27.407297 (+ 2630us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:27.407310 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:27.407404 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:27.409136 (+ 1732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:27.409143 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:27.409172 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:27.409300 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.409308 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.412462 (+ 3154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.412466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.417166 (+ 4700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.417178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.427158 (+ 9980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.427162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.427294 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.427322 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:23:27.427389 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:23:27.427469 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2546,"mutex_wait_us":510,"thread_start_us":88,"threads_started":1}
I20260812 11:23:27.428960 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.405231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42872 (local address 127.12.175.194:36975)
0812 11:23:27.407136 (+ 1905us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.407142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.407514 (+ 372us) server_negotiation.cc:407] Connection header received
0812 11:23:27.407600 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.407606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.407812 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.407958 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:27.409446 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.410954 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.417320 (+ 6366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.419154 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.428525 (+ 9371us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.428673 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.428725 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.428816 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1450,"thread_start_us":100,"threads_started":1}
I20260812 11:23:27.431731 6080 tablet_service.cc:1467] Processing CreateTablet for tablet 5fc2a6e350844688b64e70630cce28e9 (DEFAULT_TABLE table=test-table [id=d7c61dba78f04c4383d3058e2519b319]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:27.432760 6080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fc2a6e350844688b64e70630cce28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:27.435521 6551 tablet_bootstrap.cc:492] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: Bootstrap starting.
I20260812 11:23:27.449349 6551 tablet_bootstrap.cc:654] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:27.449795 6557 tablet_bootstrap.cc:492] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Bootstrap starting.
I20260812 11:23:27.450229 6551 log.cc:824] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:27.450927 6556 tablet_bootstrap.cc:492] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Bootstrap starting.
I20260812 11:23:27.452876 6556 tablet_bootstrap.cc:654] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:27.453611 6556 log.cc:824] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:27.454543 6557 tablet_bootstrap.cc:654] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:27.455353 6557 log.cc:824] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:27.465067 6557 tablet_bootstrap.cc:492] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: No bootstrap required, opened a new log
I20260812 11:23:27.465286 6557 ts_tablet_manager.cc:1397] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260812 11:23:27.469359 6557 raft_consensus.cc:348] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.469657 6557 raft_consensus.cc:374] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:27.469719 6557 raft_consensus.cc:729] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27319cd88d4c299a14c7214efc3d16, State: Initialized, Role: FOLLOWER
I20260812 11:23:27.470774 6557 consensus_queue.cc:260] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.472877 6551 tablet_bootstrap.cc:492] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: No bootstrap required, opened a new log
I20260812 11:23:27.473105 6551 ts_tablet_manager.cc:1397] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260812 11:23:27.473771 6557 ts_tablet_manager.cc:1428] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260812 11:23:27.474196 6202 heartbeater.cc:503] Master 127.12.175.254:39243 was elected leader, sending a full tablet report...
I20260812 11:23:27.474682 6556 tablet_bootstrap.cc:492] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: No bootstrap required, opened a new log
I20260812 11:23:27.474884 6556 ts_tablet_manager.cc:1397] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260812 11:23:27.477012 6551 raft_consensus.cc:348] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.477285 6551 raft_consensus.cc:374] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:27.477336 6551 raft_consensus.cc:729] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98d583603403446c847e3669ee439d62, State: Initialized, Role: FOLLOWER
I20260812 11:23:27.477845 6551 consensus_queue.cc:260] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.478823 6551 ts_tablet_manager.cc:1428] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:23:27.478806 6556 raft_consensus.cc:348] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.479048 6556 raft_consensus.cc:374] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:27.479106 6556 raft_consensus.cc:729] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d259ed8b0a043fbb2b517e7d2890057, State: Initialized, Role: FOLLOWER
I20260812 11:23:27.479152 5937 heartbeater.cc:503] Master 127.12.175.254:39243 was elected leader, sending a full tablet report...
I20260812 11:23:27.479533 6556 consensus_queue.cc:260] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.480463 6556 ts_tablet_manager.cc:1428] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 11:23:27.480789 6472 heartbeater.cc:503] Master 127.12.175.254:39243 was elected leader, sending a full tablet report...
I20260812 11:23:27.515959 6565 raft_consensus.cc:482] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:27.516165 6565 raft_consensus.cc:504] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.517494 6565 leader_election.cc:288] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98d583603403446c847e3669ee439d62 (127.12.175.193:41027), 8f27319cd88d4c299a14c7214efc3d16 (127.12.175.194:36975)
I20260812 11:23:27.523185 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.518174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:56287 (local address 127.12.175.193:41027)
0812 11:23:27.518408 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.518412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.519626 (+ 1214us) server_negotiation.cc:407] Connection header received
0812 11:23:27.519835 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.519838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.519888 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.519941 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:27.520422 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.521006 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.522090 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.522651 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.522763 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.522817 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.522995 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.523088 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260812 11:23:27.523588 6567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.517668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:41027 (local address 127.12.175.195:56287)
0812 11:23:27.519524 (+ 1856us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:27.519539 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:27.519713 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:27.520110 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:27.520113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:27.520133 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:27.520279 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.520286 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.521138 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.521140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.521968 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.521977 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.522745 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.522748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.522847 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.522872 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:23:27.523384 (+ 512us) client_negotiation.cc:240] Negotiation successful
0812 11:23:27.523460 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1779,"thread_start_us":117,"threads_started":1}
I20260812 11:23:27.524241 5789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fc2a6e350844688b64e70630cce28e9" candidate_uuid: "8d259ed8b0a043fbb2b517e7d2890057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98d583603403446c847e3669ee439d62" is_pre_election: true
I20260812 11:23:27.524531 5789 raft_consensus.cc:2454] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d259ed8b0a043fbb2b517e7d2890057 in term 0.
I20260812 11:23:27.525172 6241 leader_election.cc:302] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d259ed8b0a043fbb2b517e7d2890057, 98d583603403446c847e3669ee439d62; no voters:
I20260812 11:23:27.525454 6565 raft_consensus.cc:2781] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:23:27.525523 6565 raft_consensus.cc:482] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:23:27.525573 6565 raft_consensus.cc:3037] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:27.526875 6565 raft_consensus.cc:504] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.527196 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.518020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:54733 (local address 127.12.175.194:36975)
0812 11:23:27.518316 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.518321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.522272 (+ 3951us) server_negotiation.cc:407] Connection header received
0812 11:23:27.522440 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.522443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.522488 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.522531 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:27.523913 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.524583 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.525963 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.526518 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.526607 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.526655 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.526995 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.527087 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207}
I20260812 11:23:27.527210 6565 leader_election.cc:288] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [CANDIDATE]: Term 1 election: Requested vote from peers 98d583603403446c847e3669ee439d62 (127.12.175.193:41027), 8f27319cd88d4c299a14c7214efc3d16 (127.12.175.194:36975)
I20260812 11:23:27.527592 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.517772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36975 (local address 127.12.175.195:54733)
0812 11:23:27.522193 (+ 4421us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:27.522205 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:27.522335 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:27.522659 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:27.522662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:27.522677 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:27.523785 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.523793 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.524725 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.524727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.525823 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:27.525834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.526751 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.526755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:27.526851 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.526874 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:23:27.527393 (+ 519us) client_negotiation.cc:240] Negotiation successful
0812 11:23:27.527467 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3708,"thread_start_us":115,"threads_started":1}
I20260812 11:23:27.528055 5789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fc2a6e350844688b64e70630cce28e9" candidate_uuid: "8d259ed8b0a043fbb2b517e7d2890057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98d583603403446c847e3669ee439d62"
I20260812 11:23:27.528177 5789 raft_consensus.cc:3037] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:27.528236 6120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fc2a6e350844688b64e70630cce28e9" candidate_uuid: "8d259ed8b0a043fbb2b517e7d2890057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27319cd88d4c299a14c7214efc3d16" is_pre_election: true
I20260812 11:23:27.528532 6120 raft_consensus.cc:2454] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d259ed8b0a043fbb2b517e7d2890057 in term 0.
I20260812 11:23:27.528860 6119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fc2a6e350844688b64e70630cce28e9" candidate_uuid: "8d259ed8b0a043fbb2b517e7d2890057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27319cd88d4c299a14c7214efc3d16"
I20260812 11:23:27.528987 6119 raft_consensus.cc:3037] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:27.529254 5789 raft_consensus.cc:2454] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d259ed8b0a043fbb2b517e7d2890057 in term 1.
I20260812 11:23:27.529549 6241 leader_election.cc:302] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d259ed8b0a043fbb2b517e7d2890057, 98d583603403446c847e3669ee439d62; no voters:
I20260812 11:23:27.529904 6565 raft_consensus.cc:2781] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:27.530139 6565 raft_consensus.cc:686] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 1 LEADER]: Becoming Leader. State: Replica: 8d259ed8b0a043fbb2b517e7d2890057, State: Running, Role: LEADER
I20260812 11:23:27.530336 6119 raft_consensus.cc:2454] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d259ed8b0a043fbb2b517e7d2890057 in term 1.
I20260812 11:23:27.530459 6565 consensus_queue.cc:237] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } }
I20260812 11:23:27.533828 5535 catalog_manager.cc:5495] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d259ed8b0a043fbb2b517e7d2890057 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "8d259ed8b0a043fbb2b517e7d2890057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d259ed8b0a043fbb2b517e7d2890057" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 33567 } health_report { overall_health: HEALTHY } } }
W20260812 11:23:27.555770 5940 tablet.cc:2369] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:27.573305 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.569249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55486 (local address 127.12.175.195:33567)
0812 11:23:27.569566 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:27.569570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:27.569581 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:23:27.569648 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:27.569651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:27.569700 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:27.569791 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:27.570065 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.570563 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.571446 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:27.571770 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:27.571876 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:27.572297 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:27.572843 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:27.572956 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:27.573097 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:23:27.573160 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240}
W20260812 11:23:27.579484 6203 tablet.cc:2369] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:27.580286 6119 raft_consensus.cc:1261] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 1 FOLLOWER]: Refusing update from remote peer 8d259ed8b0a043fbb2b517e7d2890057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:27.581046 6572 consensus_queue.cc:1035] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27319cd88d4c299a14c7214efc3d16" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:27.581478 5789 raft_consensus.cc:1261] T 5fc2a6e350844688b64e70630cce28e9 P 98d583603403446c847e3669ee439d62 [term 1 FOLLOWER]: Refusing update from remote peer 8d259ed8b0a043fbb2b517e7d2890057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:27.582129 6572 consensus_queue.cc:1035] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98d583603403446c847e3669ee439d62" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:23:27.583592 6473 tablet.cc:2369] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:27.595465 6578 mvcc.cc:205] Tried to move back new op lower bound from 7317642475839741952 to 7317642475647631360. Current Snapshot: MvccSnapshot[applied={T|T < 7317642475839741952}]
I20260812 11:23:27.595661 6580 mvcc.cc:205] Tried to move back new op lower bound from 7317642475839741952 to 7317642475647631360. Current Snapshot: MvccSnapshot[applied={T|T < 7317642475839741952}]
I20260812 11:23:27.596195 6584 mvcc.cc:205] Tried to move back new op lower bound from 7317642475839741952 to 7317642475647631360. Current Snapshot: MvccSnapshot[applied={T|T < 7317642475839741952}]
I20260812 11:23:27.604462 5535 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:27.604607 5535 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:27.607074 5535 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 447a187c01614b328646487b5928f81a: Sending DeleteTablet for 3 replicas of tablet 5fc2a6e350844688b64e70630cce28e9
I20260812 11:23:27.608012 5749 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc2a6e350844688b64e70630cce28e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:27 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:51788
I20260812 11:23:27.608814 6080 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc2a6e350844688b64e70630cce28e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:27 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42872
I20260812 11:23:27.609036 6345 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fc2a6e350844688b64e70630cce28e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:27 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:55476
I20260812 11:23:27.610025 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 5611
I20260812 11:23:27.623503 6600 tablet_replica.cc:330] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: stopping tablet replica
I20260812 11:23:27.623950 6600 raft_consensus.cc:2229] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:27.624308 6600 raft_consensus.cc:2258] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:27.625910 6600 ts_tablet_manager.cc:1905] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:27.628732 6600 ts_tablet_manager.cc:1918] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:27.628829 6600 log.cc:1196] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/5fc2a6e350844688b64e70630cce28e9
I20260812 11:23:27.629159 6600 ts_tablet_manager.cc:1939] T 5fc2a6e350844688b64e70630cce28e9 P 8f27319cd88d4c299a14c7214efc3d16: Deleting consensus metadata
I20260812 11:23:27.630450 5513 catalog_manager.cc:4841] TS 8f27319cd88d4c299a14c7214efc3d16 (127.12.175.194:36975): tablet 5fc2a6e350844688b64e70630cce28e9 (table test-table [id=d7c61dba78f04c4383d3058e2519b319]) successfully deleted
I20260812 11:23:27.631208 6601 tablet_replica.cc:330] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: stopping tablet replica
I20260812 11:23:27.633080 6601 raft_consensus.cc:2229] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:23:27.633575 6601 raft_consensus.cc:2258] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:27.636615 6601 ts_tablet_manager.cc:1905] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:27.639364 6601 ts_tablet_manager.cc:1918] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:27.644037 6601 log.cc:1196] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/5fc2a6e350844688b64e70630cce28e9
I20260812 11:23:27.644383 6601 ts_tablet_manager.cc:1939] T 5fc2a6e350844688b64e70630cce28e9 P 8d259ed8b0a043fbb2b517e7d2890057: Deleting consensus metadata
W20260812 11:23:27.644833 5514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:41027 (error 108)
I20260812 11:23:27.645411 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 5941
I20260812 11:23:27.684705 5518 catalog_manager.cc:4841] TS 8d259ed8b0a043fbb2b517e7d2890057 (127.12.175.195:33567): tablet 5fc2a6e350844688b64e70630cce28e9 (table test-table [id=d7c61dba78f04c4383d3058e2519b319]) successfully deleted
I20260812 11:23:27.685463 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:27.685111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:41027 (local address 127.0.0.1:51796)
0812 11:23:27.685286 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:27.685359 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:41027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260812 11:23:27.685655 5514 catalog_manager.cc:4584] TS 98d583603403446c847e3669ee439d62 (127.12.175.193:41027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5fc2a6e350844688b64e70630cce28e9: Network error: Client connection negotiation failed: client connection to 127.12.175.193:41027: connect: Connection refused (error 111)
I20260812 11:23:27.691170 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 6206
I20260812 11:23:27.700165 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 5480
I20260812 11:23:27.716004 12991 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:23:28.059763 12991 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:23:28.059868 12991 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:23:28.403550 12991 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:23:28.403 UTC [3646] LOG: received smart shutdown request
2026-08-12 11:23:28.407 UTC [3646] LOG: background worker "logical replication launcher" (PID 3678) exited with exit code 1
2026-08-12 11:23:28.407 UTC [3656] LOG: shutting down
2026-08-12 11:23:28.546 UTC [3646] LOG: database system is shut down
2026-08-12T11:23:28Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45931 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:28 dist-test-slave-gjrz krb5kdc[6636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:28 dist-test-slave-gjrz krb5kdc[6636](info): set up 2 sockets
Aug 12 11:23:28 dist-test-slave-gjrz krb5kdc[6636](info): commencing operation
krb5kdc: starting...
W20260812 11:23:29.845350 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:23:29 dist-test-slave-gjrz krb5kdc[6636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:23:29.955987 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38383
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38383,127.12.175.253:46641,127.12.175.252:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:30.061807 6663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:30.062045 6663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:30.062098 6663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:30.065996 6663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:30.066046 6663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:30.066072 6663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:30.066095 6663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:30.066123 6663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:30.071012 6663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38383,127.12.175.253:46641,127.12.175.252:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:30.071903 6663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:30.072783 6663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:30.080415 6671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:30.080456 6673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:30.080447 6676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:30.080628 6663 server_base.cc:1034] running on GCE node
I20260812 11:23:30.081230 6663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:30.082221 6663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:30.083323 6663 hybrid_clock.cc:648] HybridClock initialized: now 1786533810083307 us; error 25 us; skew 500 ppm
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:30.085796 6663 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:30.086562 6663 webserver.cc:460] Webserver started at http://127.12.175.254:38663/ using document root <none> and password file <none>
I20260812 11:23:30.087049 6663 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:30.087291 6663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:30.087515 6663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:30.089381 6663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "3afc1519128a455eb39dd6c8f58a58c2"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "588c37c852c42db0d328f622e00b1d5b"
server_key_iv: "8718ec4950ce39ea987a84bb901fe3e0"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.089905 6663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "3afc1519128a455eb39dd6c8f58a58c2"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "588c37c852c42db0d328f622e00b1d5b"
server_key_iv: "8718ec4950ce39ea987a84bb901fe3e0"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.093293 6663 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:23:30.095467 6694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:30.096525 6663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:23:30.096632 6663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "3afc1519128a455eb39dd6c8f58a58c2"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "588c37c852c42db0d328f622e00b1d5b"
server_key_iv: "8718ec4950ce39ea987a84bb901fe3e0"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.096716 6663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:30.118570 6663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:30.121080 6663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:30.121232 6663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:30.127494 6663 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:38383
I20260812 11:23:30.127763 6807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:38383 every 8 connection(s)
I20260812 11:23:30.128315 6663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:30.130674 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 6663
I20260812 11:23:30.130774 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:23:30.130793 6815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:30.131038 12991 external_mini_cluster.cc:1428] Setting key 72a61de278ee079af902dc08ca213771
I20260812 11:23:30.134728 6815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.253@KRBTEST.COM" created.
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:30.148581 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.136805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38383 (local address 127.0.0.1:38894)
0812 11:23:30.137314 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.137346 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.138089 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.138705 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.138710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.139109 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.139365 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.139380 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.140558 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.140560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.141268 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.141276 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.141865 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.141868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.141965 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.142463 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.142479 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.144047 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.146076 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.146087 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.146097 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.146308 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.146635 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.146636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.146638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.146730 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.147422 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.147427 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.147542 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.147672 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.147894 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":144,"threads_started":1}
I20260812 11:23:30.148586 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.136805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.12.175.254:38383)
0812 11:23:30.137176 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.137193 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.137440 (+ 247us) server_negotiation.cc:407] Connection header received
0812 11:23:30.138363 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.138368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.138532 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.138694 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.139513 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.140456 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.141354 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.141756 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.141868 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.144175 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.144180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.144190 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.144209 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.145955 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.146411 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.146418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.146420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.146554 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.146809 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.146812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.146814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.147320 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.147459 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.147773 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.147997 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":245,"thread_start_us":109,"threads_started":1}
I20260812 11:23:30.150585 6815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:30.151206 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.150985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42300)
0812 11:23:30.151095 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.151158 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 11:23:30.151404 6701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
I20260812 11:23:30.152209 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.152038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42308)
0812 11:23:30.152121 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.152164 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 11:23:30.152328 6815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:46641: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab.
Entry for principal kudu/127.12.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab.
I20260812 11:23:30.157382 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:46641
--webserver_interface=127.12.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab
--principal=kudu/127.12.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38383,127.12.175.253:46641,127.12.175.252:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:30.201555 6815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } attempt: 1
I20260812 11:23:30.202328 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.202051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42316)
0812 11:23:30.202196 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.202254 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 11:23:30.203027 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.202824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42318)
0812 11:23:30.202909 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.202972 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 11:23:30.203143 6815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:46641: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
W20260812 11:23:30.263543 6826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:30.263749 6826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:30.263792 6826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:30.267603 6826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:30.267647 6826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:30.267663 6826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:30.267683 6826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:30.267709 6826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:30.271286 6815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } attempt: 2
I20260812 11:23:30.272001 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.271732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42332)
0812 11:23:30.271872 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.271929 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:23:30.272639 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.272472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42338)
0812 11:23:30.272550 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.272590 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 11:23:30.272748 6815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:46641: Network error: Client connection negotiation failed: client connection to 127.12.175.253:46641: connect: Connection refused (error 111)
I20260812 11:23:30.272892 6826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38383,127.12.175.253:46641,127.12.175.252:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab
--principal=kudu/127.12.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:46641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:30.273737 6826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:30.274602 6826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:23:30.282261 6826 server_base.cc:1034] running on GCE node
W20260812 11:23:30.282204 6835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:30.282196 6833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:30.282226 6832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:30.282940 6826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:30.283964 6826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:30.285127 6826 hybrid_clock.cc:648] HybridClock initialized: now 1786533810285113 us; error 27 us; skew 500 ppm
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:30.287628 6826 init.cc:377] Logged in from keytab as kudu/127.12.175.253@KRBTEST.COM (short username kudu)
I20260812 11:23:30.288410 6826 webserver.cc:460] Webserver started at http://127.12.175.253:33085/ using document root <none> and password file <none>
I20260812 11:23:30.288930 6826 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:30.288990 6826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:30.289163 6826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:30.290948 6826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data/instance:
uuid: "bf9459b1e9a34fcdaac13bc482cb245e"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "f342271f474f78ba1452849c35b82892"
server_key_iv: "06a632010a1723222cc323905ac1336d"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.291465 6826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal/instance:
uuid: "bf9459b1e9a34fcdaac13bc482cb245e"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "f342271f474f78ba1452849c35b82892"
server_key_iv: "06a632010a1723222cc323905ac1336d"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.294754 6826 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260812 11:23:30.296912 6846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:30.297953 6826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:23:30.298069 6826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal
uuid: "bf9459b1e9a34fcdaac13bc482cb245e"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "f342271f474f78ba1452849c35b82892"
server_key_iv: "06a632010a1723222cc323905ac1336d"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.298151 6826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:30.314167 6826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:30.316676 6826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:30.316836 6826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:30.323029 6826 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.253:46641
I20260812 11:23:30.323338 6944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.253:46641 every 8 connection(s)
I20260812 11:23:30.323923 6826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
I20260812 11:23:30.326434 6945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:30.329824 6945 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:30.332692 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 6826
I20260812 11:23:30.332791 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-1/wal/instance
I20260812 11:23:30.333047 12991 external_mini_cluster.cc:1428] Setting key d9680d356d6552903e78aeb61f9202b8
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.252@KRBTEST.COM" created.
I20260812 11:23:30.344813 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.331454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38902 (local address 127.12.175.254:38383)
0812 11:23:30.331579 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.331583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.332322 (+ 739us) server_negotiation.cc:407] Connection header received
0812 11:23:30.333223 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.333227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.333286 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.333357 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.334388 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.334897 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.336012 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.336252 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.336339 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.338652 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.338656 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.338657 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.338680 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.342540 (+ 3860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.343146 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.343149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.343151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.343237 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.343629 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.343632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.343634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.343873 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.343978 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.344529 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.344658 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:23:30.345501 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.331793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38383 (local address 127.0.0.1:38902)
0812 11:23:30.332192 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.332231 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.333025 (+ 794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.333519 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.333525 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.333827 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.334255 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.334267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.335013 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.335016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.335898 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.335909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.336383 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.336388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.336548 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.337009 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.337024 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.338504 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.342666 (+ 4162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.342672 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.342687 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.343023 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.343353 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.343356 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.343359 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.343507 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.344016 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.344022 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.344273 (+ 251us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.344440 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.344735 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":106,"threads_started":1}
I20260812 11:23:30.346824 6945 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:23:30.356412 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.347316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42354)
0812 11:23:30.347407 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.347417 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.347478 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.348103 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.348106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.348250 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.348332 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.348338 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.349245 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.349249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.349742 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.349750 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.350301 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.350305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.350392 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.350760 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.350771 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.353374 (+ 2603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.355086 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.355088 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.355089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.355259 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.355553 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.355556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.355558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.355640 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.356077 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.356079 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.356150 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.356220 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.356307 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 11:23:30.356575 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.347481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42354 (local address 127.12.175.253:46641)
0812 11:23:30.347784 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.347795 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.347816 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:23:30.347849 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.347853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.347990 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.348104 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.348430 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.349140 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.349842 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.350198 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.350289 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.353503 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.353512 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.353522 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.353545 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.354988 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.355373 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.355378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.355380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.355464 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.355702 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.355704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.355705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.355972 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.356112 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.356296 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.356411 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab.
Entry for principal kudu/127.12.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab.
I20260812 11:23:30.358125 6945 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:30.358479 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:43569
--webserver_interface=127.12.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab
--principal=kudu/127.12.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:40191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38383,127.12.175.253:46641,127.12.175.252:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:30.358783 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.358516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60306)
0812 11:23:30.358644 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.358720 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 11:23:30.358970 6851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
I20260812 11:23:30.359812 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.359600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60322)
0812 11:23:30.359695 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.359748 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:23:30.359948 6945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:43569: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
I20260812 11:23:30.363890 6815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } attempt: 3
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:23:30.371950 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.364341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.12.175.253:46641)
0812 11:23:30.364445 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.364448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.364460 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:23:30.364548 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.364550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.364582 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.364644 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.365105 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.365585 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.367121 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.367405 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.367489 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.369408 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.369417 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.369418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.369439 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.370596 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.370992 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.370994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.370995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.371060 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.371309 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.371311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.371312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.371465 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.371534 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.371772 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.371854 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:23:30.372028 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.364263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42356)
0812 11:23:30.364378 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.364392 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.364470 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.364677 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.364680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.364846 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.364962 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.364970 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.365686 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.365690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.367002 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.367014 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.367518 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.367522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.367634 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.368006 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.368020 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.369289 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.370683 (+ 1394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.370686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.370688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.370913 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.371131 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.371133 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.371135 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.371214 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.371541 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.371543 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.371641 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.371737 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.371856 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 11:23:30.373052 6815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:30.373623 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.373403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60326)
0812 11:23:30.373510 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.373561 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:23:30.374188 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.373961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60342)
0812 11:23:30.374089 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.374135 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260812 11:23:30.374294 6815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:43569: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
I20260812 11:23:30.405437 6815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } attempt: 1
I20260812 11:23:30.406013 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.405780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60354)
0812 11:23:30.405895 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.405950 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 11:23:30.406616 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.406423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60358)
0812 11:23:30.406510 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.406557 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 11:23:30.406733 6815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:43569: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
I20260812 11:23:30.409158 6945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } attempt: 1
I20260812 11:23:30.409651 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.409454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60372)
0812 11:23:30.409555 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.409599 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 11:23:30.410241 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.410073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60382)
0812 11:23:30.410155 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.410194 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 11:23:30.410359 6945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:43569: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
W20260812 11:23:30.466656 6958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:30.466864 6958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:30.466899 6958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:30.470655 6958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:30.470696 6958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:30.470714 6958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:30.470728 6958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:30.470742 6958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:30.475615 6958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:40191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38383,127.12.175.253:46641,127.12.175.252:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab
--principal=kudu/127.12.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:30.476397 6958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:30.477245 6958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:23:30.478497 6945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } attempt: 2
I20260812 11:23:30.479210 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.478948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60388)
0812 11:23:30.479084 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.479139 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:23:30.479875 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.479670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60398)
0812 11:23:30.479774 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.479819 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 11:23:30.479986 6945 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:43569: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
I20260812 11:23:30.481864 6815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } attempt: 2
I20260812 11:23:30.482435 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.482216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60412)
0812 11:23:30.482326 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.482375 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 11:23:30.483074 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.482883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60420)
0812 11:23:30.482973 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.483018 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 11:23:30.483179 6815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:43569: Network error: Client connection negotiation failed: client connection to 127.12.175.252:43569: connect: Connection refused (error 111)
W20260812 11:23:30.485201 6972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:30.485224 6975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:30.485343 6958 server_base.cc:1034] running on GCE node
W20260812 11:23:30.485256 6978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:30.485988 6958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:30.486901 6958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:30.488051 6958 hybrid_clock.cc:648] HybridClock initialized: now 1786533810488015 us; error 36 us; skew 500 ppm
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:30.490439 6958 init.cc:377] Logged in from keytab as kudu/127.12.175.252@KRBTEST.COM (short username kudu)
I20260812 11:23:30.491256 6958 webserver.cc:460] Webserver started at http://127.12.175.252:43177/ using document root <none> and password file <none>
I20260812 11:23:30.491760 6958 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:30.491823 6958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:30.491988 6958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:30.493794 6958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data/instance:
uuid: "4b30a96e56d44d17b09e7069b7e25ce6"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "5405146476f895501613789c40aaa811"
server_key_iv: "52ba266ec6f6698f1a2f7232763910c0"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.494287 6958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal/instance:
uuid: "4b30a96e56d44d17b09e7069b7e25ce6"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "5405146476f895501613789c40aaa811"
server_key_iv: "52ba266ec6f6698f1a2f7232763910c0"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.497553 6958 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:23:30.499675 6990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:30.500736 6958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:30.500840 6958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal
uuid: "4b30a96e56d44d17b09e7069b7e25ce6"
format_stamp: "Formatted at 2026-08-12 11:23:30 on dist-test-slave-gjrz"
server_key: "5405146476f895501613789c40aaa811"
server_key_iv: "52ba266ec6f6698f1a2f7232763910c0"
server_key_version: "encryptionkey@0"
I20260812 11:23:30.500922 6958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:30.529058 6958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:30.531390 6958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:30.531543 6958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:30.537752 6958 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.252:43569
I20260812 11:23:30.537990 7101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.252:43569 every 8 connection(s)
I20260812 11:23:30.538575 6958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
I20260812 11:23:30.541095 7102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:30.544382 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 6958
I20260812 11:23:30.544505 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533654564615-12991-0/minicluster-data/master-2/wal/instance
I20260812 11:23:30.544749 12991 external_mini_cluster.cc:1428] Setting key 7e2f3e4e5cd2bf7a3c3952b66a80823b
I20260812 11:23:30.544513 7102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:23:30.556898 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.546652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38908 (local address 127.12.175.254:38383)
0812 11:23:30.546778 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.546782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.546999 (+ 217us) server_negotiation.cc:407] Connection header received
0812 11:23:30.547395 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.547399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.547450 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.547526 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.548480 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.549235 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.550597 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.550935 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.551032 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.553421 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.553425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.553427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.553454 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.554954 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.555486 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.555489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.555491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.555571 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.555879 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.555882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.555884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.556076 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.556163 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.556619 (+ 456us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.556751 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:23:30.557595 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.546541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38383 (local address 127.0.0.1:38908)
0812 11:23:30.546871 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.546916 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.547196 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.547600 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.547606 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.548024 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.548354 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.548368 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.549347 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.549349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.550463 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.550475 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.551082 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.551084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.551200 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.551731 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.551753 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.553278 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.555054 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.555063 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.555072 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.555384 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.555653 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.555656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.555658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.555784 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.556178 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.556184 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.556400 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.556539 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.556807 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":26,"thread_start_us":79,"threads_started":1}
I20260812 11:23:30.557600 7108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.545981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.12.175.252:43569)
0812 11:23:30.546341 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.546353 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.546383 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:23:30.547079 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.547099 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.547317 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.547490 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.548304 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.549479 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.550584 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.551147 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.551223 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.553867 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.553872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.553881 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.553902 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.555281 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.555674 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.555679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.555680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.555781 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.556045 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.556048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.556050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.556384 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.556571 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.556777 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.556903 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":243,"thread_start_us":104,"threads_started":1}
I20260812 11:23:30.558954 7102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:30.566866 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.559392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:46641 (local address 127.0.0.1:42358)
0812 11:23:30.559475 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.559488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.559556 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.559912 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.559915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.560073 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.560180 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.560187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.561018 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.561021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.561667 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.561678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.562105 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.562109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.562194 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.562564 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.562575 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.563837 (+ 1262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.565520 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.565523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.565526 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.565753 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.566010 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.566013 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.566015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.566106 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.566439 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.566442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.566523 (+ 81us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.566610 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.566727 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 11:23:30.566902 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.559489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42358 (local address 127.12.175.253:46641)
0812 11:23:30.559611 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.559614 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.559626 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:23:30.559669 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.559672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.559716 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.559792 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.560303 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.560891 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.561786 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.562007 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.562086 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.563979 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.563982 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.563985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.564013 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.565399 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.565843 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.565846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.565847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.565922 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.566188 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.566190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.566191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.566342 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.566424 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.566673 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.566773 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:23:30.567723 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.559765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38916 (local address 127.12.175.254:38383)
0812 11:23:30.559859 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.559862 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.559872 (+ 10us) server_negotiation.cc:407] Connection header received
0812 11:23:30.559980 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.559982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.560013 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.560075 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.560652 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.561237 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.562107 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.562347 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.562420 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.564820 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.564822 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.564824 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.564844 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.566243 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.566591 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.566595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.566596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.566671 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.566908 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.566911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.566913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.567110 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.567340 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.567478 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.567588 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:23:30.567826 7102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:30.571126 6945 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } attempt: 3
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:23:30.575650 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.568280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60436)
0812 11:23:30.568360 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.568372 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.568434 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.568625 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.568628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.568758 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.568816 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.568820 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.569452 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.569455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.569936 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.569952 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.570360 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.570364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.570437 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.570791 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.570804 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.572169 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.574036 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.574039 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.574040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.574217 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.574737 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.574740 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.574742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.574814 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.575192 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.575195 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.575287 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.575390 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.575510 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 11:23:30.576120 7108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.568342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60436 (local address 127.12.175.252:43569)
0812 11:23:30.568447 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.568451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.568465 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:23:30.568496 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.568499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.568532 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.568596 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.568910 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.569361 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.570042 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.570272 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.570353 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.572286 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.572290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.572292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.572315 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.573763 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.574553 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.574556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.574558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.574644 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.574905 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.574908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.574910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.575079 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.575161 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.575865 (+ 704us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.575996 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:23:30.576924 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.568649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42370 (local address 127.12.175.253:46641)
0812 11:23:30.568740 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.568743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.568791 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:23:30.568891 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.568894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.568932 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.568993 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.569516 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.569960 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.570642 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.570851 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.570933 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.573587 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.573591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.573593 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.573617 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.575164 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.575575 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.575578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.575580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.575658 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.575994 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.575997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.575999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.576194 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.576397 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.576699 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.576794 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 11:23:30.579245 7102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: Bootstrap starting.
I20260812 11:23:30.580008 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.571468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60444)
0812 11:23:30.571564 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.571577 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.571646 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.572105 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.572108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.572263 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.572343 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.572348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.573550 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.573553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.574296 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.574307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.574746 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.574749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.574828 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.575238 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.575252 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.576681 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.578487 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.578491 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.578492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.578697 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.578971 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.578974 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.578976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.579085 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.579556 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.579559 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.579652 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.579762 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.579879 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 11:23:30.580017 7111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.571548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60444 (local address 127.12.175.252:43569)
0812 11:23:30.571863 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.571872 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.571886 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:23:30.571917 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.571920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.571960 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.572049 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.572448 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.573448 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.574413 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.574651 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.574731 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.576911 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.576917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.576920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.576944 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.578376 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.578784 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.578787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.578789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.578875 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.579181 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.579184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.579185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.579452 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.579548 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.579802 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.579883 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":108,"threads_started":1}
I20260812 11:23:30.581087 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:23:30.581974 7102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:30.582336 6945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: Bootstrap starting.
I20260812 11:23:30.582839 7102 log.cc:824] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:30.583101 6815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } attempt: 3
I20260812 11:23:30.584687 6945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:30.584847 7102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: No bootstrap required, opened a new log
I20260812 11:23:30.585459 6945 log.cc:824] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:30.587039 6945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: No bootstrap required, opened a new log
Aug 12 11:23:30 dist-test-slave-gjrz krb5kdc[6636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533810, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:23:30.588671 7102 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.588896 7102 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:30.588980 7102 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b30a96e56d44d17b09e7069b7e25ce6, State: Initialized, Role: FOLLOWER
I20260812 11:23:30.589474 7102 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.590144 6945 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.590303 6945 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:30.590354 6945 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf9459b1e9a34fcdaac13bc482cb245e, State: Initialized, Role: FOLLOWER
I20260812 11:23:30.590718 6945 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.590782 7102 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:30.591125 7131 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.591346 7131 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:30.591928 6945 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:30.592262 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.583445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:43569 (local address 127.0.0.1:60456)
0812 11:23:30.583662 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:30.583675 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:30.583744 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:30.584285 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:30.584288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:30.584442 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:30.584531 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.584539 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.585495 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.585499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.586271 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:30.586282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.586848 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.586852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:30.586939 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.587383 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:30.587397 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:30.588712 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:30.590683 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.590686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.590688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.590919 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.591245 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:30.591249 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:30.591251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:30.591359 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:30.591797 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:30.591800 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:30.591894 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 11:23:30.591979 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 11:23:30.592114 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260812 11:23:30.592828 7108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.583862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60456 (local address 127.12.175.252:43569)
0812 11:23:30.584072 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.584075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.584088 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:23:30.584119 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.584121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.584158 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.584639 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.584717 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.585363 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.586418 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.586718 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.587147 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.588852 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.588856 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.588858 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.588882 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.590560 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.591039 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.591042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.591043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.591138 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.591475 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.591478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.591480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.591675 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.592521 (+ 846us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.592600 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.592699 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260812 11:23:30.595585 6815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: Bootstrap starting.
W20260812 11:23:30.595764 7163 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:30.596010 7163 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:30.597550 6815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:30.594743 6958 master_runner.cc:186] Error getting master registration for 127.12.175.254:38383: OK, instance_id { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" instance_seqno: 1786533810125835 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:23:30.597832 6958 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:23:30.598332 6815 log.cc:824] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:30.599113 6826 master_runner.cc:186] Error getting master registration for 127.12.175.254:38383: OK, instance_id { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" instance_seqno: 1786533810125835 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:23:30.603022 6826 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:23:30.604859 6815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: No bootstrap required, opened a new log
W20260812 11:23:30.605370 7177 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:30.605456 7177 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:30.606884 7111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.583840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60472 (local address 127.12.175.252:43569)
0812 11:23:30.583963 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.583967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.589335 (+ 5368us) server_negotiation.cc:407] Connection header received
0812 11:23:30.589829 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.589833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.589872 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.589916 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.599586 (+ 9670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.600306 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.601488 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.601818 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.601907 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.603640 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.603644 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.603646 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.603670 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.605141 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.605612 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.605615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.605617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.605705 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.606011 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.606014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.606016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.606218 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.606319 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.606641 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.606750 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:23:30.608879 6815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.609160 6815 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:30.609253 6815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3afc1519128a455eb39dd6c8f58a58c2, State: Initialized, Role: FOLLOWER
I20260812 11:23:30.609779 6815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.610740 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.583241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.12.175.254:38383)
0812 11:23:30.583360 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.583364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.585995 (+ 2631us) server_negotiation.cc:407] Connection header received
0812 11:23:30.598152 (+ 12157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.598155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.598201 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.598252 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.599175 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.599954 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.601138 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.601481 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.601556 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.607383 (+ 5827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.607388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.607390 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.607415 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.608948 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.609435 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.609439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.609441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.609527 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.609832 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.609835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.609837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.610035 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.610159 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.610503 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.610610 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:23:30.610932 7129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.611099 7129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:30.611615 6815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:30.615686 7182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.615793 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:30.584416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.12.175.253:46641)
0812 11:23:30.584834 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:30.584837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:30.606667 (+ 21830us) server_negotiation.cc:407] Connection header received
0812 11:23:30.606836 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:30.606839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:30.606882 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:30.606929 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:30.608287 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.608924 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.610006 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:30.610309 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:30.610385 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:30.612182 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:30.612186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:30.612189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:30.612214 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:30.613744 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.614230 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.614233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.614235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.614319 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:30.614626 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:30.614630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:30.614632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:30.614830 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:30.614935 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:30.615545 (+ 610us) server_negotiation.cc:299] Negotiation successful
0812 11:23:30.615656 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351}
I20260812 11:23:30.616356 7182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 11:23:30.617447 7208 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:30.617527 7208 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:30.619594 6663 master_runner.cc:263] No leader master found from master 3afc1519128a455eb39dd6c8f58a58c2
I20260812 11:23:30.619652 6663 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:23:30.622571 6711 tablet.cc:2369] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:23:30.782698 7000 tablet.cc:2369] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:23:30.818148 6856 tablet.cc:2369] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:30.871521 7131 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:30.871707 7131 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.872596 7131 leader_election.cc:288] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3afc1519128a455eb39dd6c8f58a58c2 (127.12.175.254:38383), 4b30a96e56d44d17b09e7069b7e25ce6 (127.12.175.252:43569)
I20260812 11:23:30.873085 6753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3afc1519128a455eb39dd6c8f58a58c2" is_pre_election: true
I20260812 11:23:30.873134 7046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" is_pre_election: true
I20260812 11:23:30.873413 7046 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf9459b1e9a34fcdaac13bc482cb245e in term 0.
I20260812 11:23:30.873412 6753 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf9459b1e9a34fcdaac13bc482cb245e in term 0.
I20260812 11:23:30.873799 6851 leader_election.cc:302] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3afc1519128a455eb39dd6c8f58a58c2, bf9459b1e9a34fcdaac13bc482cb245e; no voters:
I20260812 11:23:30.874089 7131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:23:30.874166 7131 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:23:30.874194 7131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:30.875247 7131 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.875604 7131 leader_election.cc:288] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [CANDIDATE]: Term 1 election: Requested vote from peers 3afc1519128a455eb39dd6c8f58a58c2 (127.12.175.254:38383), 4b30a96e56d44d17b09e7069b7e25ce6 (127.12.175.252:43569)
I20260812 11:23:30.875949 6753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3afc1519128a455eb39dd6c8f58a58c2"
I20260812 11:23:30.876075 6753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:30.876477 7046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b30a96e56d44d17b09e7069b7e25ce6"
I20260812 11:23:30.876605 7046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:30.877291 6753 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf9459b1e9a34fcdaac13bc482cb245e in term 1.
I20260812 11:23:30.877554 6851 leader_election.cc:302] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3afc1519128a455eb39dd6c8f58a58c2, bf9459b1e9a34fcdaac13bc482cb245e; no voters:
I20260812 11:23:30.877724 7131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:30.877770 7046 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf9459b1e9a34fcdaac13bc482cb245e in term 1.
I20260812 11:23:30.877904 7131 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [term 1 LEADER]: Becoming Leader. State: Replica: bf9459b1e9a34fcdaac13bc482cb245e, State: Running, Role: LEADER
I20260812 11:23:30.878222 7131 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } }
I20260812 11:23:30.880111 7212 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf9459b1e9a34fcdaac13bc482cb245e. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.880224 7212 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:30.880561 7215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:30.881443 7215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:30.885599 6753 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [term 1 FOLLOWER]: Refusing update from remote peer bf9459b1e9a34fcdaac13bc482cb245e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:30.885636 7046 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [term 1 FOLLOWER]: Refusing update from remote peer bf9459b1e9a34fcdaac13bc482cb245e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:30.886181 7212 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:30.886334 7131 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:30.889808 7129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf9459b1e9a34fcdaac13bc482cb245e. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.889922 7129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:30.890009 7182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf9459b1e9a34fcdaac13bc482cb245e. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.890116 7182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:30.892143 7131 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.892241 7131 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:30.892621 7129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.892727 7129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:30.893191 7219 mvcc.cc:205] Tried to move back new op lower bound from 7317642489382125568 to 7317642489359507456. Current Snapshot: MvccSnapshot[applied={T|T < 7317642489382125568}]
I20260812 11:23:30.893487 7212 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.893586 7212 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:30.893711 7215 catalog_manager.cc:1347] Generated new cluster ID: ec4df3cc7eba40349a4c8c71b034d698
I20260812 11:23:30.893769 7215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:30.894554 7182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3afc1519128a455eb39dd6c8f58a58c2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38383 } } peers { permanent_uuid: "bf9459b1e9a34fcdaac13bc482cb245e" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 46641 } } peers { permanent_uuid: "4b30a96e56d44d17b09e7069b7e25ce6" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 43569 } } }
I20260812 11:23:30.894654 7182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:30.909341 7215 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:30.910231 7215 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:30.915607 7215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf9459b1e9a34fcdaac13bc482cb245e: Generated new TSK 0
I20260812 11:23:30.916369 7215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:23:31.597229 7163 catalog_manager.cc:1259] Loaded cluster ID: ec4df3cc7eba40349a4c8c71b034d698
I20260812 11:23:31.597302 7163 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: loading cluster ID for follower catalog manager: success
I20260812 11:23:31.598923 7163 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: acquiring CA information for follower catalog manager: success
I20260812 11:23:31.600183 7163 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4b30a96e56d44d17b09e7069b7e25ce6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:23:31.618551 7208 catalog_manager.cc:1259] Loaded cluster ID: ec4df3cc7eba40349a4c8c71b034d698
I20260812 11:23:31.618610 7208 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: loading cluster ID for follower catalog manager: success
I20260812 11:23:31.620146 7208 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: acquiring CA information for follower catalog manager: success
I20260812 11:23:31.621191 7208 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3afc1519128a455eb39dd6c8f58a58c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:23:31.972549 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 6663
I20260812 11:23:31.989333 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 6826
I20260812 11:23:31.999791 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 6958
2026-08-12T11:23:32Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3357 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:32 dist-test-slave-gjrz krb5kdc[7239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:32 dist-test-slave-gjrz krb5kdc[7239](info): set up 2 sockets
Aug 12 11:23:32 dist-test-slave-gjrz krb5kdc[7239](info): commencing operation
krb5kdc: starting...
W20260812 11:23:33.198800 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:23:33 dist-test-slave-gjrz krb5kdc[7239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:23:33.311585 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:46739
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:46739
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:33.416720 7261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:33.416934 7261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:33.416986 7261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:33.420853 7261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:33.420902 7261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:33.420928 7261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:33.420949 7261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:33.420977 7261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:33.425925 7261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:46739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:33.426787 7261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:33.427685 7261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:33.435427 7275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:33.435437 7277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:33.435467 7274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:33.435786 7261 server_base.cc:1034] running on GCE node
I20260812 11:23:33.436395 7261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:33.437348 7261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:33.438508 7261 hybrid_clock.cc:648] HybridClock initialized: now 1786533813438485 us; error 35 us; skew 500 ppm
Aug 12 11:23:33 dist-test-slave-gjrz krb5kdc[7239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533813, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:33.441006 7261 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:33.441785 7261 webserver.cc:460] Webserver started at http://127.12.175.254:43031/ using document root <none> and password file <none>
I20260812 11:23:33.442286 7261 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:33.442344 7261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:33.442535 7261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:33.444425 7261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "9a0b43c9f1ab4791897aa269ecfaca43"
format_stamp: "Formatted at 2026-08-12 11:23:33 on dist-test-slave-gjrz"
server_key: "abbc0fb3210a3e97122d028fcb2440fe"
server_key_iv: "e1c9c65a27ab3af7865bc7c944d8f605"
server_key_version: "encryptionkey@0"
I20260812 11:23:33.444991 7261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "9a0b43c9f1ab4791897aa269ecfaca43"
format_stamp: "Formatted at 2026-08-12 11:23:33 on dist-test-slave-gjrz"
server_key: "abbc0fb3210a3e97122d028fcb2440fe"
server_key_iv: "e1c9c65a27ab3af7865bc7c944d8f605"
server_key_version: "encryptionkey@0"
I20260812 11:23:33.448400 7261 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:23:33.450544 7287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:33.451681 7261 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:23:33.451797 7261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "9a0b43c9f1ab4791897aa269ecfaca43"
format_stamp: "Formatted at 2026-08-12 11:23:33 on dist-test-slave-gjrz"
server_key: "abbc0fb3210a3e97122d028fcb2440fe"
server_key_iv: "e1c9c65a27ab3af7865bc7c944d8f605"
server_key_version: "encryptionkey@0"
I20260812 11:23:33.451889 7261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:33.480898 7261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:33.483497 7261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:33.483669 7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:33.490046 7261 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:46739
I20260812 11:23:33.490074 7392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:46739 every 8 connection(s)
I20260812 11:23:33.490938 7261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:33.494350 7393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:33.496927 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 7261
I20260812 11:23:33.497061 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:23:33.497386 12991 external_mini_cluster.cc:1428] Setting key 819625990b2014bd380728a5e10e6ad4
I20260812 11:23:33.500747 7393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43: Bootstrap starting.
I20260812 11:23:33.502847 7393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:33.503576 7393 log.cc:824] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:33.505383 7393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43: No bootstrap required, opened a new log
Aug 12 11:23:33 dist-test-slave-gjrz krb5kdc[7239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:33.508661 7393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46739 } }
I20260812 11:23:33.508867 7393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:33.508912 7393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a0b43c9f1ab4791897aa269ecfaca43, State: Initialized, Role: FOLLOWER
I20260812 11:23:33.509347 7393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46739 } }
I20260812 11:23:33.509508 7393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:33.509586 7393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:33.509689 7393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:33.510557 7393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46739 } }
I20260812 11:23:33.510908 7393 leader_election.cc:302] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a0b43c9f1ab4791897aa269ecfaca43; no voters:
I20260812 11:23:33.511222 7393 leader_election.cc:288] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:23:33.511330 7406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:33.511483 7406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [term 1 LEADER]: Becoming Leader. State: Replica: 9a0b43c9f1ab4791897aa269ecfaca43, State: Running, Role: LEADER
I20260812 11:23:33.511837 7406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46739 } }
I20260812 11:23:33.512051 7400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:33.498621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.12.175.254:46739)
0812 11:23:33.499707 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:33.499727 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:33.499771 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:23:33.500385 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:33.500401 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:33.500706 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:33.501050 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:33.501811 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:33.502802 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:33.503714 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:33.504344 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:33.504489 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:33.507035 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:33.507040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:33.507060 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:33.507086 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:33.509175 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:33.509633 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:33.509639 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:33.509645 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:33.509775 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:33.510049 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:33.510050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:33.510052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:33.510405 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:33.510541 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:33.510869 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 11:23:33.511160 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":937,"thread_start_us":122,"threads_started":1}
I20260812 11:23:33.512415 7393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:33.514204 7407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46739 } } }
I20260812 11:23:33.514319 7407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:33.514513 7407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a0b43c9f1ab4791897aa269ecfaca43. Latest consensus state: current_term: 1 leader_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0b43c9f1ab4791897aa269ecfaca43" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 46739 } } }
I20260812 11:23:33.514757 7407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:33.515178 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 11:23:33.517763 7429 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:33.517843 7429 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:33.517910 7431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:33.518589 7431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:33.523375 7431 catalog_manager.cc:1347] Generated new cluster ID: c688bf810ec24ce084b54147062c5850
I20260812 11:23:33.523422 7431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:33.543033 7431 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:33.543890 7431 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:33.550135 7431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a0b43c9f1ab4791897aa269ecfaca43: Generated new TSK 0
I20260812 11:23:33.550671 7431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:23:33.570168 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 7261
2026-08-12T11:23:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1579 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:33 dist-test-slave-gjrz krb5kdc[7445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:33 dist-test-slave-gjrz krb5kdc[7445](info): set up 2 sockets
Aug 12 11:23:33 dist-test-slave-gjrz krb5kdc[7445](info): commencing operation
krb5kdc: starting...
W20260812 11:23:35.295717 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.692s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:23:35 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:23:35.624264 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42705
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:42705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:35.869302 7467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:35.869541 7467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:35.869592 7467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:35.873456 7467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:35.873505 7467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:35.873530 7467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:35.873550 7467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:35.873572 7467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:35.878552 7467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:42705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:35.879477 7467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:35.880386 7467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:35.888760 7486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:35.888818 7492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:35.888852 7467 server_base.cc:1034] running on GCE node
W20260812 11:23:35.888758 7488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:35.889479 7467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:35.890497 7467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:35.891650 7467 hybrid_clock.cc:648] HybridClock initialized: now 1786533815891638 us; error 28 us; skew 500 ppm
Aug 12 11:23:35 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533815, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:35.894122 7467 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:35.894933 7467 webserver.cc:460] Webserver started at http://127.12.175.254:32837/ using document root <none> and password file <none>
I20260812 11:23:35.895483 7467 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:35.895548 7467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:35.895744 7467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:35.897660 7467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "e009d0cdad0f4c60a3a3dbbf468b9899"
format_stamp: "Formatted at 2026-08-12 11:23:35 on dist-test-slave-gjrz"
server_key: "054f55d35f140d55b04dfee82c3f9691"
server_key_iv: "ab41d3a45c4cc0281897d3d6f3631b55"
server_key_version: "encryptionkey@0"
I20260812 11:23:35.898175 7467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "e009d0cdad0f4c60a3a3dbbf468b9899"
format_stamp: "Formatted at 2026-08-12 11:23:35 on dist-test-slave-gjrz"
server_key: "054f55d35f140d55b04dfee82c3f9691"
server_key_iv: "ab41d3a45c4cc0281897d3d6f3631b55"
server_key_version: "encryptionkey@0"
I20260812 11:23:35.901551 7467 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:23:35.903844 7503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:35.904989 7467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:23:35.905104 7467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "e009d0cdad0f4c60a3a3dbbf468b9899"
format_stamp: "Formatted at 2026-08-12 11:23:35 on dist-test-slave-gjrz"
server_key: "054f55d35f140d55b04dfee82c3f9691"
server_key_iv: "ab41d3a45c4cc0281897d3d6f3631b55"
server_key_version: "encryptionkey@0"
I20260812 11:23:35.905189 7467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:35.920537 7467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:35.923030 7467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:35.923187 7467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:35.929476 7467 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:42705
I20260812 11:23:35.929718 7625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:42705 every 8 connection(s)
I20260812 11:23:35.930330 7467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:35.932909 7629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:35.937112 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 7467
I20260812 11:23:35.937222 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:23:35.937527 12991 external_mini_cluster.cc:1428] Setting key 2f657ff9753e277f9a67d4c20615bcbb
I20260812 11:23:35.938146 7629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap starting.
I20260812 11:23:35.940536 7629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:35.941398 7629 log.cc:824] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:35.943506 7629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: No bootstrap required, opened a new log
Aug 12 11:23:35 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:35.947571 7629 raft_consensus.cc:348] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:35.947789 7629 raft_consensus.cc:374] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:35.947847 7629 raft_consensus.cc:729] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e009d0cdad0f4c60a3a3dbbf468b9899, State: Initialized, Role: FOLLOWER
I20260812 11:23:35.948258 7629 consensus_queue.cc:260] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:35.948416 7629 raft_consensus.cc:388] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:35.948498 7629 raft_consensus.cc:482] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:35.948598 7629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:35.949498 7629 raft_consensus.cc:504] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:35.949851 7629 leader_election.cc:302] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e009d0cdad0f4c60a3a3dbbf468b9899; no voters:
I20260812 11:23:35.950189 7629 leader_election.cc:288] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:23:35.950255 7644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:35.950450 7644 raft_consensus.cc:686] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 LEADER]: Becoming Leader. State: Replica: e009d0cdad0f4c60a3a3dbbf468b9899, State: Running, Role: LEADER
I20260812 11:23:35.950806 7644 consensus_queue.cc:237] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:35.951071 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:35.938720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43782 (local address 127.12.175.254:42705)
0812 11:23:35.939095 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:35.939110 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:35.939143 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:23:35.939762 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:35.939780 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:35.940128 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:35.940386 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:35.941263 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:35.942241 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:35.943369 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:35.943839 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:35.943950 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:35.946585 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:35.946590 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:35.946603 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:35.946628 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:35.948221 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:35.948680 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:35.948687 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:35.948692 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:35.948808 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:35.949097 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:35.949099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:35.949100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:35.949474 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:35.949636 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:35.949898 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 11:23:35.950177 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":108,"threads_started":1}
I20260812 11:23:35.951445 7629 sys_catalog.cc:564] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:35.952402 7646 sys_catalog.cc:455] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e009d0cdad0f4c60a3a3dbbf468b9899. Latest consensus state: current_term: 1 leader_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } } }
I20260812 11:23:35.952531 7646 sys_catalog.cc:458] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:35.952752 7646 sys_catalog.cc:455] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } } }
I20260812 11:23:35.952827 7646 sys_catalog.cc:458] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:35.952903 7659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:35.955612 7659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:35.960431 7659 catalog_manager.cc:1347] Generated new cluster ID: 3c07d49c76e541b1ac314486c23aac89
I20260812 11:23:35.960496 7659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:35.976907 7659 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:35.978034 7659 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:35.985457 7659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Generated new TSK 0
I20260812 11:23:35.986001 7659 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:23:36.019747 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42705
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:36.125764 7682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:36.125974 7682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:36.126016 7682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:36.129812 7682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:36.129858 7682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:36.129926 7682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:23:36.134807 7682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:36.135677 7682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:36.136545 7682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:36.145414 7705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:36.145463 7700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:36.145473 7698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:36.145689 7682 server_base.cc:1034] running on GCE node
I20260812 11:23:36.146122 7682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:36.146695 7682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:36.147847 7682 hybrid_clock.cc:648] HybridClock initialized: now 1786533816147826 us; error 32 us; skew 500 ppm
Aug 12 11:23:36 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:36.150353 7682 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:23:36.151129 7682 webserver.cc:460] Webserver started at http://127.12.175.193:44615/ using document root <none> and password file <none>
I20260812 11:23:36.151687 7682 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:36.151763 7682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:36.151960 7682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:36.153961 7682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "4707ecf130ec0a9e6808c2ca449b34ee"
server_key_iv: "d8d4bfb7d1601d397f1aea04de465638"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.154479 7682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "4707ecf130ec0a9e6808c2ca449b34ee"
server_key_iv: "d8d4bfb7d1601d397f1aea04de465638"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.157905 7682 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:23:36.160128 7723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.161213 7682 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:23:36.161319 7682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "4707ecf130ec0a9e6808c2ca449b34ee"
server_key_iv: "d8d4bfb7d1601d397f1aea04de465638"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.161406 7682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:36.182420 7682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:36.185278 7682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:36.185443 7682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:36.185962 7682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:36.186715 7682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:36.186761 7682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.186810 7682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:36.186837 7682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.195091 7682 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:45575
I20260812 11:23:36.195124 7934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:45575 every 8 connection(s)
I20260812 11:23:36.195919 7682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
Aug 12 11:23:36 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:36.205291 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 7682
I20260812 11:23:36.205417 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:23:36.205755 12991 external_mini_cluster.cc:1428] Setting key 6d2dc6db1ac620b44222e8e06eb11ec4
I20260812 11:23:36.208496 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.197529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:46925 (local address 127.12.175.254:42705)
0812 11:23:36.197660 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.197665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.198384 (+ 719us) server_negotiation.cc:407] Connection header received
0812 11:23:36.199759 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.199763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.199821 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.199898 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:36.200978 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.201511 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.202631 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.202895 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.202983 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.205172 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:36.205176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:36.205178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:36.205201 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:36.206534 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.206993 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.206996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.206997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.207082 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.207437 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.207440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.207442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.207614 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:36.207700 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.208219 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.208341 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:23:36.209242 7937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.197839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:46925)
0812 11:23:36.198250 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.198290 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.199550 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.200067 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.200074 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.200390 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:36.200837 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.200850 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.201635 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.201638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.202506 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.202516 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.203033 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.203038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.203201 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.203705 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:36.203721 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:36.205011 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:36.206644 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:36.206650 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:36.206663 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:36.206897 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:36.207169 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:36.207172 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:36.207174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:36.207349 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:36.207716 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:36.207723 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:36.207976 (+ 253us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.208148 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.208435 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":117,"threads_started":1}
I20260812 11:23:36.210407 7935 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42705
I20260812 11:23:36.210610 7935 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:36.211032 7935 heartbeater.cc:511] Master 127.12.175.254:42705 requested a full tablet report, sending...
I20260812 11:23:36.212440 7552 ts_manager.cc:194] Registered new tserver with Master: 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193:45575)
I20260812 11:23:36.213513 7552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:46925
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:23:36.232127 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42705
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:36.339681 7943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:36.339892 7943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:36.339931 7943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:36.343892 7943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:36.343940 7943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:36.344004 7943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:23:36.348944 7943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:36.349821 7943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:36.350728 7943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:36.359710 7952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:36.359723 7954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:36.359778 7943 server_base.cc:1034] running on GCE node
W20260812 11:23:36.359728 7957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:36.360280 7943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:36.360847 7943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:36.362028 7943 hybrid_clock.cc:648] HybridClock initialized: now 1786533816362014 us; error 24 us; skew 500 ppm
Aug 12 11:23:36 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:36.364677 7943 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:23:36.365551 7943 webserver.cc:460] Webserver started at http://127.12.175.194:41829/ using document root <none> and password file <none>
I20260812 11:23:36.366104 7943 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:36.366171 7943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:36.366367 7943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:36.368332 7943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "58cc537e88234b36a9bc036965a0fc44"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "03390e77e55a1648f62b2a522d607d43"
server_key_iv: "47d766ea52d5e235129061512bcd973a"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.368844 7943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "58cc537e88234b36a9bc036965a0fc44"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "03390e77e55a1648f62b2a522d607d43"
server_key_iv: "47d766ea52d5e235129061512bcd973a"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.372218 7943 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:23:36.374387 7970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.375595 7943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:23:36.375698 7943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "58cc537e88234b36a9bc036965a0fc44"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "03390e77e55a1648f62b2a522d607d43"
server_key_iv: "47d766ea52d5e235129061512bcd973a"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.375787 7943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:36.396044 7943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:36.398466 7943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:36.398620 7943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:36.399122 7943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:36.399864 7943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:36.399911 7943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.399969 7943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:36.399997 7943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.407842 7943 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:33889
I20260812 11:23:36.407894 8207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:33889 every 8 connection(s)
I20260812 11:23:36.408674 7943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
Aug 12 11:23:36 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:36.417573 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 7943
I20260812 11:23:36.417689 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:23:36.417955 12991 external_mini_cluster.cc:1428] Setting key 2913245dcf703c62dc010078074a5769
I20260812 11:23:36.421068 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.410291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:33849 (local address 127.12.175.254:42705)
0812 11:23:36.410419 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.410424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.411228 (+ 804us) server_negotiation.cc:407] Connection header received
0812 11:23:36.412537 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.412539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.412588 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.412658 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:36.413665 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.414180 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.415221 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.415481 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.415554 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.417686 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:36.417690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:36.417694 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:36.417721 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:36.419107 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.419670 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.419672 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.419674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.419751 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.420109 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.420110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.420111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.420266 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:36.420335 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.420851 (+ 516us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.420945 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:23:36.421972 8210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.410671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:33849)
0812 11:23:36.411090 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.411130 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.412345 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.412797 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.412804 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.413122 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:36.413559 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.413572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.414271 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.414274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.415129 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.415139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.415599 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.415602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.415736 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.416183 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:36.416198 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:36.417514 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:36.419223 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:36.419229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:36.419241 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:36.419576 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:36.419836 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:36.419839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:36.419841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:36.420032 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:36.420354 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:36.420360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:36.420633 (+ 273us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.420830 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.421146 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":111,"threads_started":1}
I20260812 11:23:36.423050 8208 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42705
I20260812 11:23:36.423283 8208 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:36.423697 8208 heartbeater.cc:511] Master 127.12.175.254:42705 requested a full tablet report, sending...
I20260812 11:23:36.424650 7552 ts_manager.cc:194] Registered new tserver with Master: 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889)
I20260812 11:23:36.425242 7552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:33849
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:23:36.444001 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42705
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:36.550047 8215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:36.550247 8215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:36.550285 8215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:36.554214 8215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:36.554263 8215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:36.554328 8215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:23:36.559222 8215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:36.560077 8215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:36.560941 8215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:36.569630 8233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:36.569649 8232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:36.569707 8236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:36.569754 8215 server_base.cc:1034] running on GCE node
I20260812 11:23:36.570246 8215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:36.570815 8215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:36.571971 8215 hybrid_clock.cc:648] HybridClock initialized: now 1786533816571954 us; error 28 us; skew 500 ppm
Aug 12 11:23:36 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:36.574476 8215 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:23:36.575215 8215 webserver.cc:460] Webserver started at http://127.12.175.195:33907/ using document root <none> and password file <none>
I20260812 11:23:36.575728 8215 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:36.575793 8215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:36.575973 8215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:36.577811 8215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "d942588183a7491ea5042fd9512f3b7d"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "c86c66280650a04234201466a105e824"
server_key_iv: "916af0e77c053c01c868ee591688a61d"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.578322 8215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "d942588183a7491ea5042fd9512f3b7d"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "c86c66280650a04234201466a105e824"
server_key_iv: "916af0e77c053c01c868ee591688a61d"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.581772 8215 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260812 11:23:36.583974 8258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.585037 8215 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:23:36.585141 8215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "d942588183a7491ea5042fd9512f3b7d"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "c86c66280650a04234201466a105e824"
server_key_iv: "916af0e77c053c01c868ee591688a61d"
server_key_version: "encryptionkey@0"
I20260812 11:23:36.585228 8215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:36.602612 8215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:36.605289 8215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:36.605446 8215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:36.605928 8215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:36.606659 8215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:36.606706 8215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.606753 8215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:36.606781 8215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:36.614988 8215 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:42667
I20260812 11:23:36.615028 8495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:42667 every 8 connection(s)
I20260812 11:23:36.615801 8215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:23:36.619503 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 8215
I20260812 11:23:36.619601 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:23:36.619875 12991 external_mini_cluster.cc:1428] Setting key e2464c022c7a8a681e0a3e4c8b2fc20e
Aug 12 11:23:36 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533816, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:36.628407 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.617331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:33473 (local address 127.12.175.254:42705)
0812 11:23:36.617444 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.617448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.618190 (+ 742us) server_negotiation.cc:407] Connection header received
0812 11:23:36.619503 (+ 1313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.619506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.619570 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.619653 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:36.621094 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.621836 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.622945 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.623174 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.623280 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.625399 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:36.625403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:36.625406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:36.625433 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:36.626520 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.626965 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.626969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.626970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.627075 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.627418 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.627421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.627423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.627601 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:36.627688 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.628141 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.628255 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:23:36.629072 8498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.617621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:33473)
0812 11:23:36.618046 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.618085 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.619292 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.619871 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.619880 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.620306 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:36.620908 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.620929 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.621970 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.621973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.622826 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.622836 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.623328 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.623332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.623491 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.623966 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:36.623982 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:36.625249 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:36.626625 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:36.626631 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:36.626644 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:36.626873 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:36.627162 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:36.627165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:36.627167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:36.627330 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:36.627698 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:36.627704 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:36.627919 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.628064 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.628365 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":116,"threads_started":1}
I20260812 11:23:36.630038 8496 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42705
I20260812 11:23:36.630251 8496 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:36.630683 8496 heartbeater.cc:511] Master 127.12.175.254:42705 requested a full tablet report, sending...
I20260812 11:23:36.631630 7552 ts_manager.cc:194] Registered new tserver with Master: d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
I20260812 11:23:36.632144 7552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:33473
I20260812 11:23:36.633383 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:23:36.641758 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.635121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43794 (local address 127.12.175.254:42705)
0812 11:23:36.635216 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.635220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.635433 (+ 213us) server_negotiation.cc:407] Connection header received
0812 11:23:36.635557 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.635560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.635600 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.635661 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:36.636300 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.636766 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.637562 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.637779 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.637861 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.638997 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:36.639001 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:36.639003 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:36.639025 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:36.640234 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.640608 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.640612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.640614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.640684 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:36.640940 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:36.640944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:36.640945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:36.641182 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:36.641297 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.641525 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.641623 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 11:23:36.644177 7552 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:23:36.646909 7552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:23:36.660872 8520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.654762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:45575 (local address 127.0.0.1:42296)
0812 11:23:36.655075 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.655127 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.655252 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.656732 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.656735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.656752 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:36.656851 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.656859 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.657859 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.657862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.659332 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.659344 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.660412 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.660415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.660501 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.660530 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.660624 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.660739 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":45,"thread_start_us":72,"threads_started":1}
I20260812 11:23:36.660903 8526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.655430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42296 (local address 127.12.175.193:45575)
0812 11:23:36.655878 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.656344 (+ 466us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.656374 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:23:36.656455 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.656461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.656602 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.656730 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:36.656964 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.657732 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.659451 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.660292 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.660416 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.660538 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.660679 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.660769 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":140,"threads_started":1}
I20260812 11:23:36.661612 8524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.655457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:33889 (local address 127.0.0.1:45980)
0812 11:23:36.656248 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.656260 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.656355 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.656979 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.656981 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.657000 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:36.657069 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.657074 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.658289 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.658293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.659376 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.659387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.661220 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.661224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.661310 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.661334 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.661402 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.661480 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":20,"thread_start_us":86,"threads_started":1}
I20260812 11:23:36.661926 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.654879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42667 (local address 127.0.0.1:57436)
0812 11:23:36.655800 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.655813 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.655898 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.656575 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.656581 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.656603 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:36.656714 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.656721 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.658037 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.658040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.659332 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.659344 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.661326 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.661329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.661415 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.661438 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.661513 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.661587 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"mutex_wait_us":57,"thread_start_us":84,"threads_started":1}
I20260812 11:23:36.662190 8527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.655862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.12.175.194:33889)
0812 11:23:36.656212 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.656223 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.656409 (+ 186us) server_negotiation.cc:407] Connection header received
0812 11:23:36.656492 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.656497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.656694 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.656832 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:36.657184 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.658177 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.659510 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.660292 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.660416 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.660538 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.661952 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.662049 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":145,"threads_started":1}
I20260812 11:23:36.662470 8523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.655245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57436 (local address 127.12.175.195:42667)
0812 11:23:36.655604 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.655615 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.655993 (+ 378us) server_negotiation.cc:407] Connection header received
0812 11:23:36.656071 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.656076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.656269 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.656413 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:36.656842 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.657908 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.660607 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.661215 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.661326 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.661447 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.661540 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.662350 (+ 810us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":135,"threads_started":1}
I20260812 11:23:36.664041 7812 tablet_service.cc:1467] Processing CreateTablet for tablet cafc539818724ed691a9facd6b5f0b3a (DEFAULT_TABLE table=test-table [id=76910a9d72ab4659be9e04da65a3cef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:36.664525 8068 tablet_service.cc:1467] Processing CreateTablet for tablet cafc539818724ed691a9facd6b5f0b3a (DEFAULT_TABLE table=test-table [id=76910a9d72ab4659be9e04da65a3cef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:36.665254 7812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cafc539818724ed691a9facd6b5f0b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:36.665436 8068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cafc539818724ed691a9facd6b5f0b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:36.665095 8350 tablet_service.cc:1467] Processing CreateTablet for tablet cafc539818724ed691a9facd6b5f0b3a (DEFAULT_TABLE table=test-table [id=76910a9d72ab4659be9e04da65a3cef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:36.666049 8350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cafc539818724ed691a9facd6b5f0b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:36.670965 8532 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Bootstrap starting.
I20260812 11:23:36.672891 8534 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap starting.
I20260812 11:23:36.673530 8532 tablet_bootstrap.cc:654] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:36.674224 8532 log.cc:824] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:36.674557 8534 tablet_bootstrap.cc:654] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:36.675603 8534 log.cc:824] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:36.675926 8532 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: No bootstrap required, opened a new log
I20260812 11:23:36.676141 8532 ts_tablet_manager.cc:1397] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:23:36.676211 8536 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Bootstrap starting.
I20260812 11:23:36.677856 8536 tablet_bootstrap.cc:654] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:36.678834 8536 log.cc:824] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:36.679083 8532 raft_consensus.cc:348] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.679363 8532 raft_consensus.cc:374] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:36.679422 8532 raft_consensus.cc:729] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58cc537e88234b36a9bc036965a0fc44, State: Initialized, Role: FOLLOWER
I20260812 11:23:36.679831 8532 consensus_queue.cc:260] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.680202 8534 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: No bootstrap required, opened a new log
I20260812 11:23:36.680365 8534 ts_tablet_manager.cc:1397] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 11:23:36.680392 8208 heartbeater.cc:503] Master 127.12.175.254:42705 was elected leader, sending a full tablet report...
I20260812 11:23:36.681528 8532 ts_tablet_manager.cc:1428] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:23:36.683211 8536 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: No bootstrap required, opened a new log
I20260812 11:23:36.683415 8536 ts_tablet_manager.cc:1397] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 11:23:36.683403 8534 raft_consensus.cc:348] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.683652 8534 raft_consensus.cc:374] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:36.683715 8534 raft_consensus.cc:729] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac6d0de48fb46d28f8cfa36c58f1c92, State: Initialized, Role: FOLLOWER
I20260812 11:23:36.684098 8534 consensus_queue.cc:260] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.684706 7935 heartbeater.cc:503] Master 127.12.175.254:42705 was elected leader, sending a full tablet report...
I20260812 11:23:36.684919 8534 ts_tablet_manager.cc:1428] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:23:36.687523 8536 raft_consensus.cc:348] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.687721 8536 raft_consensus.cc:374] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:36.687768 8536 raft_consensus.cc:729] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d942588183a7491ea5042fd9512f3b7d, State: Initialized, Role: FOLLOWER
I20260812 11:23:36.688131 8536 consensus_queue.cc:260] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.688705 8496 heartbeater.cc:503] Master 127.12.175.254:42705 was elected leader, sending a full tablet report...
I20260812 11:23:36.688990 8536 ts_tablet_manager.cc:1428] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
W20260812 11:23:36.696933 7936 tablet.cc:2369] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:36.834599 8548 raft_consensus.cc:482] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:36.834808 8548 raft_consensus.cc:504] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.835949 8548 leader_election.cc:288] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667), 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889)
I20260812 11:23:36.839607 8523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.836302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:53633 (local address 127.12.175.195:42667)
0812 11:23:36.836429 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.836434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.836510 (+ 76us) server_negotiation.cc:407] Connection header received
0812 11:23:36.836705 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.836709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.836762 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.836838 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:36.837110 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.837607 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.838630 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.839021 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.839125 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.839181 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.839427 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.839498 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:23:36.839619 8555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.836160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42667 (local address 127.12.175.193:53633)
0812 11:23:36.836428 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.836444 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.836565 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.836860 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.836863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.836884 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:36.836993 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.836999 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.837706 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.837709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.838503 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.838512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.839183 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.839187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.839303 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.839328 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.839399 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.839468 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":94,"threads_started":1}
I20260812 11:23:36.839988 8527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.836686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:53429 (local address 127.12.175.194:33889)
0812 11:23:36.836811 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.836816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.836996 (+ 180us) server_negotiation.cc:407] Connection header received
0812 11:23:36.837107 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.837110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.837157 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.837219 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:36.837475 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.837964 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.838932 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.839448 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.839564 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.839614 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.839805 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.839874 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:23:36.840178 8385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cafc539818724ed691a9facd6b5f0b3a" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d942588183a7491ea5042fd9512f3b7d" is_pre_election: true
I20260812 11:23:36.840324 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.836530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:33889 (local address 127.12.175.193:53429)
0812 11:23:36.836913 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.836924 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:36.837016 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:36.837235 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:36.837238 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:36.837254 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:36.837371 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.837375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.838074 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.838077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.838812 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:36.838819 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.839557 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.839561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:36.839665 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.839687 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:23:36.840133 (+ 446us) client_negotiation.cc:240] Negotiation successful
0812 11:23:36.840209 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":115,"threads_started":1}
I20260812 11:23:36.840476 8385 raft_consensus.cc:2454] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 0.
I20260812 11:23:36.840893 8104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cafc539818724ed691a9facd6b5f0b3a" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58cc537e88234b36a9bc036965a0fc44" is_pre_election: true
I20260812 11:23:36.840930 7728 leader_election.cc:302] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92, d942588183a7491ea5042fd9512f3b7d; no voters:
I20260812 11:23:36.841187 8104 raft_consensus.cc:2454] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 0.
I20260812 11:23:36.841204 8548 raft_consensus.cc:2781] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:23:36.841295 8548 raft_consensus.cc:482] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:23:36.841346 8548 raft_consensus.cc:3037] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:36.842338 8548 raft_consensus.cc:504] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.842638 8548 leader_election.cc:288] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 election: Requested vote from peers d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667), 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889)
I20260812 11:23:36.843020 8104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cafc539818724ed691a9facd6b5f0b3a" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58cc537e88234b36a9bc036965a0fc44"
I20260812 11:23:36.843106 8385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cafc539818724ed691a9facd6b5f0b3a" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d942588183a7491ea5042fd9512f3b7d"
I20260812 11:23:36.843142 8104 raft_consensus.cc:3037] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:36.843211 8385 raft_consensus.cc:3037] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:36.844396 8104 raft_consensus.cc:2454] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 1.
I20260812 11:23:36.844396 8385 raft_consensus.cc:2454] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 1.
I20260812 11:23:36.844676 7728 leader_election.cc:302] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58cc537e88234b36a9bc036965a0fc44, 5ac6d0de48fb46d28f8cfa36c58f1c92; no voters:
I20260812 11:23:36.844825 8548 raft_consensus.cc:2781] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:36.845009 8548 raft_consensus.cc:686] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 LEADER]: Becoming Leader. State: Replica: 5ac6d0de48fb46d28f8cfa36c58f1c92, State: Running, Role: LEADER
I20260812 11:23:36.845465 8548 consensus_queue.cc:237] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:36.848315 7552 catalog_manager.cc:5495] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } health_report { overall_health: UNKNOWN } } }
W20260812 11:23:36.866614 8497 tablet.cc:2369] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:36.895943 8526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.892659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42304 (local address 127.12.175.193:45575)
0812 11:23:36.892784 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:36.892788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:36.892802 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:23:36.892936 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:36.892939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:36.892992 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:36.893078 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:36.893312 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.893794 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.894609 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:36.894817 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:36.894902 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:36.895182 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:36.895595 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:36.895700 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:36.895765 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 11:23:36.895820 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:23:36.901417 8104 raft_consensus.cc:1261] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Refusing update from remote peer 5ac6d0de48fb46d28f8cfa36c58f1c92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:36.901417 8385 raft_consensus.cc:1261] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Refusing update from remote peer 5ac6d0de48fb46d28f8cfa36c58f1c92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:36.902055 8548 consensus_queue.cc:1035] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:36.902237 8560 consensus_queue.cc:1035] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:36.909511 8568 mvcc.cc:205] Tried to move back new op lower bound from 7317642514021384192 to 7317642513801412608. Current Snapshot: MvccSnapshot[applied={T|T < 7317642514021384192}]
I20260812 11:23:36.909600 8570 mvcc.cc:205] Tried to move back new op lower bound from 7317642514021384192 to 7317642513801412608. Current Snapshot: MvccSnapshot[applied={T|T < 7317642514021384192}]
I20260812 11:23:36.916955 7550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:36.917092 7550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:36.919302 7550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Sending DeleteTablet for 3 replicas of tablet cafc539818724ed691a9facd6b5f0b3a
I20260812 11:23:36.919977 7812 tablet_service.cc:1514] Processing DeleteTablet for tablet cafc539818724ed691a9facd6b5f0b3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:36 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42296
I20260812 11:23:36.920044 8068 tablet_service.cc:1514] Processing DeleteTablet for tablet cafc539818724ed691a9facd6b5f0b3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:36 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:45980
I20260812 11:23:36.920457 8585 tablet_replica.cc:330] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: stopping tablet replica
I20260812 11:23:36.920482 8350 tablet_service.cc:1514] Processing DeleteTablet for tablet cafc539818724ed691a9facd6b5f0b3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:36 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:57436
I20260812 11:23:36.920755 8585 raft_consensus.cc:2229] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:23:36.920944 8588 tablet_replica.cc:330] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: stopping tablet replica
I20260812 11:23:36.921046 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 7682
I20260812 11:23:36.921118 8585 raft_consensus.cc:2258] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:36.927481 8588 raft_consensus.cc:2229] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:36.927845 8588 raft_consensus.cc:2258] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:36.931469 8588 ts_tablet_manager.cc:1905] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:36.933823 8588 ts_tablet_manager.cc:1918] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:36.933959 8588 log.cc:1196] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/cafc539818724ed691a9facd6b5f0b3a
I20260812 11:23:36.934531 8588 ts_tablet_manager.cc:1939] T cafc539818724ed691a9facd6b5f0b3a P d942588183a7491ea5042fd9512f3b7d: Deleting consensus metadata
I20260812 11:23:36.937813 7508 catalog_manager.cc:4841] TS d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667): tablet cafc539818724ed691a9facd6b5f0b3a (table test-table [id=76910a9d72ab4659be9e04da65a3cef4]) successfully deleted
I20260812 11:23:36.950805 8586 tablet_replica.cc:330] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: stopping tablet replica
I20260812 11:23:36.951120 8586 raft_consensus.cc:2229] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:36.951463 8586 raft_consensus.cc:2258] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:36.952797 8586 ts_tablet_manager.cc:1905] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:36.954900 8586 ts_tablet_manager.cc:1918] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:36.954988 8586 log.cc:1196] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/cafc539818724ed691a9facd6b5f0b3a
I20260812 11:23:36.955230 8586 ts_tablet_manager.cc:1939] T cafc539818724ed691a9facd6b5f0b3a P 58cc537e88234b36a9bc036965a0fc44: Deleting consensus metadata
I20260812 11:23:36.956290 7508 catalog_manager.cc:4841] TS 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889): tablet cafc539818724ed691a9facd6b5f0b3a (table test-table [id=76910a9d72ab4659be9e04da65a3cef4]) successfully deleted
W20260812 11:23:36.957154 7505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:45575 (error 108)
I20260812 11:23:36.957435 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 7943
I20260812 11:23:36.958344 8524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:36.958081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:45575 (local address 127.0.0.1:42316)
0812 11:23:36.958206 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:36.958272 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:45575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 11:23:36.958534 7505 catalog_manager.cc:4584] TS 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193:45575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cafc539818724ed691a9facd6b5f0b3a: Network error: Client connection negotiation failed: client connection to 127.12.175.193:45575: connect: Connection refused (error 111)
I20260812 11:23:36.968878 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 8215
I20260812 11:23:36.979797 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 7467
I20260812 11:23:36.989255 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42705
--webserver_interface=127.12.175.254
--webserver_port=32837
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:42705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:37.096659 8590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:37.096880 8590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:37.096916 8590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:37.100797 8590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:37.100844 8590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:37.100862 8590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:37.100876 8590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:37.100893 8590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:37.105950 8590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:42705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=32837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:37.106897 8590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:37.107837 8590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:37.120573 8612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.120616 8590 server_base.cc:1034] running on GCE node
W20260812 11:23:37.120748 8617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:37.120645 8610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.121325 8590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:37.122361 8590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:37.123517 8590 hybrid_clock.cc:648] HybridClock initialized: now 1786533817123499 us; error 30 us; skew 500 ppm
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:37.126111 8590 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:37.126941 8590 webserver.cc:460] Webserver started at http://127.12.175.254:32837/ using document root <none> and password file <none>
I20260812 11:23:37.127524 8590 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:37.127724 8590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:37.131412 8590 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 11:23:37.133430 8631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.134604 8590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:37.134714 8590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "e009d0cdad0f4c60a3a3dbbf468b9899"
format_stamp: "Formatted at 2026-08-12 11:23:35 on dist-test-slave-gjrz"
server_key: "054f55d35f140d55b04dfee82c3f9691"
server_key_iv: "ab41d3a45c4cc0281897d3d6f3631b55"
server_key_version: "encryptionkey@0"
I20260812 11:23:37.135283 8590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:37.152925 8590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:37.155618 8590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:37.155805 8590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:37.168628 8590 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:42705
I20260812 11:23:37.168901 8738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:42705 every 8 connection(s)
I20260812 11:23:37.169962 8590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:37.175772 8741 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:23:37.176452 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 8590
I20260812 11:23:37.176857 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:45575
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:42705
--webserver_port=44615
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:37.177664 8741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap starting.
I20260812 11:23:37.200043 8741 log.cc:824] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:37.211349 8741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:23:37.211736 8741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap complete.
I20260812 11:23:37.217075 8741 raft_consensus.cc:348] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:37.217554 8741 raft_consensus.cc:729] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e009d0cdad0f4c60a3a3dbbf468b9899, State: Initialized, Role: FOLLOWER
I20260812 11:23:37.218101 8741 consensus_queue.cc:260] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:37.218245 8741 raft_consensus.cc:388] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:37.218317 8741 raft_consensus.cc:482] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:37.218410 8741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:23:37.220834 8741 raft_consensus.cc:504] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:37.221199 8741 leader_election.cc:302] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e009d0cdad0f4c60a3a3dbbf468b9899; no voters:
I20260812 11:23:37.221536 8741 leader_election.cc:288] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:23:37.221637 8746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:23:37.221868 8746 raft_consensus.cc:686] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 LEADER]: Becoming Leader. State: Replica: e009d0cdad0f4c60a3a3dbbf468b9899, State: Running, Role: LEADER
I20260812 11:23:37.222180 8746 consensus_queue.cc:237] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:37.222754 8741 sys_catalog.cc:564] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:37.223026 8755 sys_catalog.cc:455] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e009d0cdad0f4c60a3a3dbbf468b9899. Latest consensus state: current_term: 2 leader_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } } }
I20260812 11:23:37.223148 8755 sys_catalog.cc:458] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:37.223430 8752 sys_catalog.cc:455] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } } }
I20260812 11:23:37.223519 8752 sys_catalog.cc:458] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:37.223865 8757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:37.228715 8757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:37.229332 8757 catalog_manager.cc:1259] Loaded cluster ID: 3c07d49c76e541b1ac314486c23aac89
I20260812 11:23:37.229395 8757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:37.230782 8757 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 11:23:37.235589 8757 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 11:23:37.240492 8757 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:37.241159 8757 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Loaded TSK: 0
I20260812 11:23:37.242291 8757 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:23:37.302887 8744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:37.303099 8744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:37.303155 8744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:37.307114 8744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:37.307166 8744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:37.307245 8744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:23:37.312109 8744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:45575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=44615
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:37.312973 8744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:37.313835 8744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:37.323851 8792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:37.323969 8791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:37.324038 8794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.324323 8744 server_base.cc:1034] running on GCE node
I20260812 11:23:37.324735 8744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:37.325322 8744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:37.326476 8744 hybrid_clock.cc:648] HybridClock initialized: now 1786533817326454 us; error 39 us; skew 500 ppm
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:37.329138 8744 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:23:37.329986 8744 webserver.cc:460] Webserver started at http://127.12.175.193:44615/ using document root <none> and password file <none>
I20260812 11:23:37.330475 8744 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:37.330565 8744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:37.334249 8744 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:37.336301 8816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.337442 8744 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:23:37.337534 8744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "4707ecf130ec0a9e6808c2ca449b34ee"
server_key_iv: "d8d4bfb7d1601d397f1aea04de465638"
server_key_version: "encryptionkey@0"
I20260812 11:23:37.338035 8744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:37.350314 8744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:37.353184 8744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:37.353345 8744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:37.353890 8744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:37.354962 8834 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:23:37.358852 8744 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:23:37.358906 8744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260812 11:23:37.358949 8744 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:23:37.360535 8744 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:23:37.360600 8744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 11:23:37.360868 8834 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap starting.
I20260812 11:23:37.370823 8744 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:45575
I20260812 11:23:37.370873 9055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:45575 every 8 connection(s)
I20260812 11:23:37.371994 8744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:23:37.375703 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 8744
I20260812 11:23:37.376113 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:33889
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:42705
--webserver_port=41829
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:37.381331 8834 log.cc:824] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:37.389153 8834 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:23:37.389407 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.374077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:49281)
0812 11:23:37.374559 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.374599 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.375365 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.376745 (+ 1380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.376753 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.377198 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:37.377795 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.377815 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.379113 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.379116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.380007 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.380018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.380917 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.380922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.381118 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.381761 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:37.381776 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:37.383508 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:37.385904 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.385910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.385924 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.386289 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.386702 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.386706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.386708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.386887 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.387614 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:37.387621 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:37.387936 (+ 315us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.388147 (+ 211us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.388471 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":152,"threads_started":1}
I20260812 11:23:37.389560 8834 tablet_bootstrap.cc:492] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap complete.
I20260812 11:23:37.389806 9059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.373992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:49281 (local address 127.12.175.254:42705)
0812 11:23:37.374319 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.374335 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.374711 (+ 376us) server_negotiation.cc:407] Connection header received
0812 11:23:37.375816 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.375832 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.376247 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.376688 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:37.378000 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.378960 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.380126 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.380760 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.380913 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.383715 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:37.383722 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:37.383737 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:37.383770 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:37.385776 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.386426 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.386432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.386437 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.386600 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.387010 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.387013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.387015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.387490 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:37.387635 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.388306 (+ 671us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.388603 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":92,"threads_started":1}
I20260812 11:23:37.390653 8834 ts_tablet_manager.cc:1397] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent bootstrapping tablet: real 0.030s user 0.018s sys 0.008s
I20260812 11:23:37.392189 9057 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42705
I20260812 11:23:37.392412 9057 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:37.392915 9057 heartbeater.cc:511] Master 127.12.175.254:42705 requested a full tablet report, sending...
I20260812 11:23:37.393222 8834 raft_consensus.cc:348] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:37.393599 8834 raft_consensus.cc:729] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac6d0de48fb46d28f8cfa36c58f1c92, State: Initialized, Role: FOLLOWER
I20260812 11:23:37.394023 8834 consensus_queue.cc:260] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } }
I20260812 11:23:37.394866 8834 ts_tablet_manager.cc:1428] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20260812 11:23:37.395421 8654 ts_manager.cc:194] Registered new tserver with Master: 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193:45575)
I20260812 11:23:37.399092 8654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:49281
I20260812 11:23:37.401234 9057 heartbeater.cc:503] Master 127.12.175.254:42705 was elected leader, sending a full tablet report...
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:23:37.407862 9071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.398400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:45575 (local address 127.0.0.1:42320)
0812 11:23:37.399026 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.399058 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.399191 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.399625 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.399630 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.399990 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:37.400089 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.400098 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.401420 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.401424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.402161 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.402173 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.402715 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.402719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.402826 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.403321 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:37.403335 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:37.404701 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:37.406277 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.406285 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.406290 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.406491 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.406763 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.406766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.406768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.406841 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.407321 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:37.407327 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:37.407441 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.407562 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.407726 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":88,"threads_started":1}
I20260812 11:23:37.408373 9075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.398469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42320 (local address 127.12.175.193:45575)
0812 11:23:37.398814 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.398825 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.399147 (+ 322us) server_negotiation.cc:407] Connection header received
0812 11:23:37.399342 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.399347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.399486 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.399598 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:37.400209 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.401294 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.402276 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.402621 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.402717 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.404826 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:37.404834 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:37.404843 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:37.404864 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:37.406175 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.406597 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.406602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.406603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.406677 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.406922 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.406926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.406928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.407145 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:37.408035 (+ 890us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.408141 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.408267 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":93,"threads_started":1}
I20260812 11:23:37.409211 8922 tablet_service.cc:1514] Processing DeleteTablet for tablet cafc539818724ed691a9facd6b5f0b3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:36 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42320
I20260812 11:23:37.409895 9078 tablet_replica.cc:330] stopping tablet replica
I20260812 11:23:37.410137 9078 raft_consensus.cc:2229] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:37.410336 9078 raft_consensus.cc:2258] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:37.411099 9078 ts_tablet_manager.cc:1905] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:37.414337 9078 ts_tablet_manager.cc:1918] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:37.414413 9078 log.cc:1196] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/cafc539818724ed691a9facd6b5f0b3a
I20260812 11:23:37.414620 9078 ts_tablet_manager.cc:1939] T cafc539818724ed691a9facd6b5f0b3a P 5ac6d0de48fb46d28f8cfa36c58f1c92: Deleting consensus metadata
I20260812 11:23:37.416168 8632 catalog_manager.cc:4841] TS 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193:45575): tablet cafc539818724ed691a9facd6b5f0b3a (table test-table [id=76910a9d72ab4659be9e04da65a3cef4]) successfully deleted
W20260812 11:23:37.491083 9062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:37.491320 9062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:37.491380 9062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:37.495440 9062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:37.495499 9062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:37.495585 9062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:23:37.500871 9062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:33889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=41829
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:37.501741 9062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:37.502635 9062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:37.511399 9087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.511416 9062 server_base.cc:1034] running on GCE node
W20260812 11:23:37.511412 9085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:37.511412 9090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.511948 9062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:37.512491 9062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:37.513644 9062 hybrid_clock.cc:648] HybridClock initialized: now 1786533817513633 us; error 29 us; skew 500 ppm
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:37.516043 9062 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:23:37.516790 9062 webserver.cc:460] Webserver started at http://127.12.175.194:41829/ using document root <none> and password file <none>
I20260812 11:23:37.517287 9062 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:37.517385 9062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:37.520982 9062 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:23:37.522785 9106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.524000 9062 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:37.524093 9062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "58cc537e88234b36a9bc036965a0fc44"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "03390e77e55a1648f62b2a522d607d43"
server_key_iv: "47d766ea52d5e235129061512bcd973a"
server_key_version: "encryptionkey@0"
I20260812 11:23:37.524569 9062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:37.539126 9062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:37.541632 9062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:37.541785 9062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:37.542332 9062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:37.543090 9062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:37.543144 9062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.543185 9062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:37.543215 9062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.551077 9062 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:33889
I20260812 11:23:37.551134 9374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:33889 every 8 connection(s)
I20260812 11:23:37.551975 9062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:23:37.553983 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 9062
I20260812 11:23:37.554401 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:42667
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:42705
--webserver_port=33907
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:37.565315 9059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.553559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:34863 (local address 127.12.175.254:42705)
0812 11:23:37.553682 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.553686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.554497 (+ 811us) server_negotiation.cc:407] Connection header received
0812 11:23:37.556200 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.556204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.556270 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.556366 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:37.557427 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.558166 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.559258 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.559650 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.559765 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.561909 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:37.561913 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:37.561916 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:37.561946 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:37.563441 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.563893 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.563896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.563899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.563992 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.564281 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.564283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.564285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.564507 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:37.564623 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.565015 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.565147 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:23:37.565889 9383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.553880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:34863)
0812 11:23:37.554350 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.554403 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.555962 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.556522 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.556529 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.556842 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:37.557284 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.557297 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.558271 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.558274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.559120 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.559132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.559783 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.559786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.559923 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.560402 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:37.560417 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:37.561734 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:37.563553 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.563558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.563568 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.563800 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.564075 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.564078 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.564079 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.564196 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.564605 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:37.564609 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:37.564805 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.564941 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.565154 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":127,"threads_started":1}
I20260812 11:23:37.566964 9379 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42705
I20260812 11:23:37.567164 9379 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:37.567623 9379 heartbeater.cc:511] Master 127.12.175.254:42705 requested a full tablet report, sending...
I20260812 11:23:37.568565 8654 ts_manager.cc:194] Registered new tserver with Master: 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889)
I20260812 11:23:37.569085 8654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:34863
W20260812 11:23:37.661738 9384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:37.661960 9384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:37.662005 9384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:37.665841 9384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:37.665886 9384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:37.665951 9384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:23:37.670790 9384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:42667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=33907
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:37.671648 9384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:37.672518 9384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:37.681180 9392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:37.681187 9393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.681365 9384 server_base.cc:1034] running on GCE node
W20260812 11:23:37.681236 9403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:37.681825 9384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:37.682389 9384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:37.683539 9384 hybrid_clock.cc:648] HybridClock initialized: now 1786533817683520 us; error 29 us; skew 500 ppm
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:37.685990 9384 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:23:37.686722 9384 webserver.cc:460] Webserver started at http://127.12.175.195:33907/ using document root <none> and password file <none>
I20260812 11:23:37.687186 9384 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:37.687252 9384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:37.690666 9384 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 11:23:37.692529 9418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.693610 9384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:23:37.693704 9384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "d942588183a7491ea5042fd9512f3b7d"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "c86c66280650a04234201466a105e824"
server_key_iv: "916af0e77c053c01c868ee591688a61d"
server_key_version: "encryptionkey@0"
I20260812 11:23:37.694183 9384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:37.707967 9384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:37.710680 9384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:37.710836 9384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:37.711380 9384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:37.712113 9384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:37.712159 9384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.712208 9384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:37.712234 9384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:37.720199 9384 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:42667
I20260812 11:23:37.720249 9643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:42667 every 8 connection(s)
I20260812 11:23:37.721069 9384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
Aug 12 11:23:37 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533817, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:37.731195 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 9384
I20260812 11:23:37.733361 9059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.722625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:40575 (local address 127.12.175.254:42705)
0812 11:23:37.722763 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.722767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.723602 (+ 835us) server_negotiation.cc:407] Connection header received
0812 11:23:37.724935 (+ 1333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.724938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.724984 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.725053 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:37.726042 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.726540 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.727676 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.727887 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.727980 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.730074 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:37.730077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:37.730079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:37.730104 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:37.731194 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.731773 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.731777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.731779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.731872 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.732248 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.732252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.732254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.732487 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:37.732567 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.733087 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.733203 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:23:37.734282 9651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.722975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:40575)
0812 11:23:37.723441 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.723493 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.724758 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.725193 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.725200 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.725505 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:37.725931 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.725944 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.726628 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.726630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.727587 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.727597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.728014 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.728019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.728154 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.728583 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:37.728598 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:37.729909 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:37.731324 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.731329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.731344 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.731677 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.731980 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:37.731983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:37.731985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:37.732143 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:37.732581 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:37.732587 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:37.732830 (+ 243us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.732971 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.733206 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":112,"threads_started":1}
I20260812 11:23:37.735397 9648 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42705
I20260812 11:23:37.735615 9648 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:37.736152 9648 heartbeater.cc:511] Master 127.12.175.254:42705 requested a full tablet report, sending...
I20260812 11:23:37.737226 8654 ts_manager.cc:194] Registered new tserver with Master: d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
I20260812 11:23:37.737931 8654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:40575
I20260812 11:23:37.740208 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.731849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43798 (local address 127.12.175.254:42705)
0812 11:23:37.732099 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.732102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.732371 (+ 269us) server_negotiation.cc:407] Connection header received
0812 11:23:37.732487 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.732489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.732539 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.732625 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:37.733384 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.734171 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.735215 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.735575 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.735656 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.737024 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:37.737028 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:37.737031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:37.737055 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:37.738606 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.739061 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.739064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.739065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.739130 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:37.739462 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:37.739465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:37.739466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:37.739656 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:37.739860 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.740002 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.740098 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":93,"threads_started":1}
I20260812 11:23:37.741731 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:23:37.745711 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.742282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43804 (local address 127.12.175.254:42705)
0812 11:23:37.742386 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.742389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.742552 (+ 163us) server_negotiation.cc:407] Connection header received
0812 11:23:37.742698 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.742701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.742781 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.742860 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:37.743084 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.743657 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.744453 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.744684 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.744769 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.745052 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:37.745368 (+ 316us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:37.745466 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.745555 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.745606 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:23:37.746320 8654 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:23:37.749402 8654 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:23:37.756480 8922 tablet_service.cc:1467] Processing CreateTablet for tablet 73ab1be500c54f5390c4d67adfe5d105 (DEFAULT_TABLE table=test-table [id=248687c74fe8432186729d2ab963d31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:37.757128 8922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73ab1be500c54f5390c4d67adfe5d105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:37.759719 8834 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap starting.
I20260812 11:23:37.760586 8834 tablet_bootstrap.cc:654] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:37.760594 9071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.755432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:33889 (local address 127.0.0.1:45984)
0812 11:23:37.755593 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.755607 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.755675 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.756441 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.756444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.756463 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:37.756548 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.756555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.757916 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.757919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.758817 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.758827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.760153 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.760157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.760261 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.760306 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.760390 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.760467 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 11:23:37.760669 9667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.755624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45984 (local address 127.12.175.194:33889)
0812 11:23:37.755966 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.755978 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.756001 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:23:37.756077 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.756082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.756294 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.756449 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:37.756681 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.757793 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.758954 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.760037 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.760149 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.760271 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.760427 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.760521 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":144,"threads_started":1}
I20260812 11:23:37.761410 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.755710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42667 (local address 127.0.0.1:57450)
0812 11:23:37.756093 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.756107 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.756190 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.756855 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.756858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.756879 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:37.756960 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.756967 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.758489 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.758493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.759601 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.759613 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.761034 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.761038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.761131 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.761152 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.761219 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.761290 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":60,"threads_started":1}
I20260812 11:23:37.761619 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.756055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57450 (local address 127.12.175.195:42667)
0812 11:23:37.756422 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.756433 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.756454 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:23:37.756520 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.756525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.756708 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.756849 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:37.757068 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.758349 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.759738 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.760572 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.761031 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.761149 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.761267 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.761351 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":134,"threads_started":1}
I20260812 11:23:37.762542 8834 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: No bootstrap required, opened a new log
I20260812 11:23:37.762631 8834 ts_tablet_manager.cc:1397] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 11:23:37.763017 8834 raft_consensus.cc:348] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.763121 8834 raft_consensus.cc:374] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:37.763159 8834 raft_consensus.cc:729] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac6d0de48fb46d28f8cfa36c58f1c92, State: Initialized, Role: FOLLOWER
I20260812 11:23:37.763301 8834 consensus_queue.cc:260] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.763567 8834 ts_tablet_manager.cc:1428] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:23:37.764096 9225 tablet_service.cc:1467] Processing CreateTablet for tablet 73ab1be500c54f5390c4d67adfe5d105 (DEFAULT_TABLE table=test-table [id=248687c74fe8432186729d2ab963d31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:37.764696 9518 tablet_service.cc:1467] Processing CreateTablet for tablet 73ab1be500c54f5390c4d67adfe5d105 (DEFAULT_TABLE table=test-table [id=248687c74fe8432186729d2ab963d31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:37.765170 9225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73ab1be500c54f5390c4d67adfe5d105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:37.765663 9518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73ab1be500c54f5390c4d67adfe5d105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:37.772863 9679 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Bootstrap starting.
I20260812 11:23:37.773500 9675 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Bootstrap starting.
I20260812 11:23:37.775514 9679 tablet_bootstrap.cc:654] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:37.776012 9675 tablet_bootstrap.cc:654] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:37.776417 9679 log.cc:824] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:37.776829 9675 log.cc:824] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:37.778302 9679 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: No bootstrap required, opened a new log
I20260812 11:23:37.778492 9679 ts_tablet_manager.cc:1397] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:23:37.778611 9675 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: No bootstrap required, opened a new log
I20260812 11:23:37.778787 9675 ts_tablet_manager.cc:1397] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:23:37.782249 9679 raft_consensus.cc:348] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.782343 9675 raft_consensus.cc:348] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.782507 9679 raft_consensus.cc:374] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:37.782531 9675 raft_consensus.cc:374] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:37.782568 9679 raft_consensus.cc:729] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d942588183a7491ea5042fd9512f3b7d, State: Initialized, Role: FOLLOWER
I20260812 11:23:37.782581 9675 raft_consensus.cc:729] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58cc537e88234b36a9bc036965a0fc44, State: Initialized, Role: FOLLOWER
I20260812 11:23:37.783017 9679 consensus_queue.cc:260] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.783017 9675 consensus_queue.cc:260] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.783630 9379 heartbeater.cc:503] Master 127.12.175.254:42705 was elected leader, sending a full tablet report...
I20260812 11:23:37.783828 9648 heartbeater.cc:503] Master 127.12.175.254:42705 was elected leader, sending a full tablet report...
I20260812 11:23:37.783982 9675 ts_tablet_manager.cc:1428] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260812 11:23:37.784776 9679 ts_tablet_manager.cc:1428] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
W20260812 11:23:37.802778 9380 tablet.cc:2369] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:23:37.873171 9058 tablet.cc:2369] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:37.886863 9070 raft_consensus.cc:482] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:37.887039 9070 raft_consensus.cc:504] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.888067 9070 leader_election.cc:288] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889), d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
I20260812 11:23:37.892730 9667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.888389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:58039 (local address 127.12.175.194:33889)
0812 11:23:37.888519 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.888524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.888539 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:23:37.888608 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.888611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.888656 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.889051 (+ 395us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:37.889167 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.889923 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.891493 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.892098 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.892211 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.892261 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.892543 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.892611 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:23:37.892730 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.888638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:43147 (local address 127.12.175.195:42667)
0812 11:23:37.888783 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.888788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.888923 (+ 135us) server_negotiation.cc:407] Connection header received
0812 11:23:37.889012 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.889015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.889060 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.889128 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:37.889349 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.890044 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.891489 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.892095 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.892211 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.892261 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.892543 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.892608 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:23:37.892760 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.888258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:33889 (local address 127.12.175.193:58039)
0812 11:23:37.888378 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.888391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.888488 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.888767 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.888770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.888790 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:37.888927 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.888936 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.890031 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.890034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.891385 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.891394 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.892209 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.892214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.892372 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.892443 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.892509 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.892621 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":140}
I20260812 11:23:37.892769 9690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.888519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42667 (local address 127.12.175.193:43147)
0812 11:23:37.888834 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.888845 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:37.888939 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:37.889138 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:37.889140 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:37.889151 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:37.889255 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.889260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.890130 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.890133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.891383 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:37.891394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.892226 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.892230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:37.892369 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.892437 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 11:23:37.892514 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:23:37.892610 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":42,"thread_start_us":98,"threads_started":1}
I20260812 11:23:37.893435 9561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73ab1be500c54f5390c4d67adfe5d105" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d942588183a7491ea5042fd9512f3b7d" is_pre_election: true
I20260812 11:23:37.893435 9265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73ab1be500c54f5390c4d67adfe5d105" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58cc537e88234b36a9bc036965a0fc44" is_pre_election: true
I20260812 11:23:37.893699 9265 raft_consensus.cc:2454] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 0.
I20260812 11:23:37.893704 9561 raft_consensus.cc:2454] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 0.
I20260812 11:23:37.894120 8826 leader_election.cc:302] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92, d942588183a7491ea5042fd9512f3b7d; no voters:
I20260812 11:23:37.894354 9070 raft_consensus.cc:2781] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:23:37.894428 9070 raft_consensus.cc:482] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:23:37.894457 9070 raft_consensus.cc:3037] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:37.895512 9070 raft_consensus.cc:504] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.895812 9070 leader_election.cc:288] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 election: Requested vote from peers 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889), d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
I20260812 11:23:37.896179 9265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73ab1be500c54f5390c4d67adfe5d105" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58cc537e88234b36a9bc036965a0fc44"
I20260812 11:23:37.896203 9561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73ab1be500c54f5390c4d67adfe5d105" candidate_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d942588183a7491ea5042fd9512f3b7d"
I20260812 11:23:37.896287 9265 raft_consensus.cc:3037] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:37.896299 9561 raft_consensus.cc:3037] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:37.897287 9561 raft_consensus.cc:2454] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 1.
I20260812 11:23:37.897349 9265 raft_consensus.cc:2454] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac6d0de48fb46d28f8cfa36c58f1c92 in term 1.
I20260812 11:23:37.897532 8826 leader_election.cc:302] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92, d942588183a7491ea5042fd9512f3b7d; no voters:
I20260812 11:23:37.897687 9070 raft_consensus.cc:2781] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:37.897907 9070 raft_consensus.cc:686] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 LEADER]: Becoming Leader. State: Replica: 5ac6d0de48fb46d28f8cfa36c58f1c92, State: Running, Role: LEADER
I20260812 11:23:37.898142 9070 consensus_queue.cc:237] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:37.900851 8654 catalog_manager.cc:5495] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } health_report { overall_health: HEALTHY } } }
I20260812 11:23:37.911947 9695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.909065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42334 (local address 127.12.175.193:45575)
0812 11:23:37.909262 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:37.909265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:37.909276 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:23:37.909331 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:37.909333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:37.909376 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:37.909462 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:37.909634 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.910091 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.910789 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:37.910983 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:37.911044 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:37.911218 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:37.911637 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:37.911720 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:37.911773 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 11:23:37.911817 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":75,"threads_started":1}
I20260812 11:23:37.914992 9561 raft_consensus.cc:1261] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Refusing update from remote peer 5ac6d0de48fb46d28f8cfa36c58f1c92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:37.915011 9265 raft_consensus.cc:1261] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Refusing update from remote peer 5ac6d0de48fb46d28f8cfa36c58f1c92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:37.915601 9070 consensus_queue.cc:1035] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:37.915759 9691 consensus_queue.cc:1035] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:37.930503 8647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:37.930653 8647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:37.932727 8647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Sending DeleteTablet for 3 replicas of tablet 73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:37.933362 8922 tablet_service.cc:1514] Processing DeleteTablet for tablet 73ab1be500c54f5390c4d67adfe5d105 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:37 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42320
I20260812 11:23:37.933398 9518 tablet_service.cc:1514] Processing DeleteTablet for tablet 73ab1be500c54f5390c4d67adfe5d105 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:37 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:57450
I20260812 11:23:37.933465 9225 tablet_service.cc:1514] Processing DeleteTablet for tablet 73ab1be500c54f5390c4d67adfe5d105 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:37 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:45984
I20260812 11:23:37.933786 9717 tablet_replica.cc:330] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: stopping tablet replica
I20260812 11:23:37.933880 9719 tablet_replica.cc:330] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: stopping tablet replica
I20260812 11:23:37.934016 9717 raft_consensus.cc:2229] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:23:37.934149 9719 raft_consensus.cc:2229] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:37.934259 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 8744
I20260812 11:23:37.934269 9718 tablet_replica.cc:330] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: stopping tablet replica
I20260812 11:23:37.934499 9718 raft_consensus.cc:2229] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:37.934726 9718 raft_consensus.cc:2258] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:37.942457 9719 raft_consensus.cc:2258] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:37.946617 9718 ts_tablet_manager.cc:1905] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:37.946946 9719 ts_tablet_manager.cc:1905] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:37.948855 9718 ts_tablet_manager.cc:1918] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:37.948928 9718 log.cc:1196] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:37.949183 9718 ts_tablet_manager.cc:1939] T 73ab1be500c54f5390c4d67adfe5d105 P d942588183a7491ea5042fd9512f3b7d: Deleting consensus metadata
I20260812 11:23:37.950160 9719 ts_tablet_manager.cc:1918] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:37.950269 9719 log.cc:1196] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:37.950711 9719 ts_tablet_manager.cc:1939] T 73ab1be500c54f5390c4d67adfe5d105 P 58cc537e88234b36a9bc036965a0fc44: Deleting consensus metadata
I20260812 11:23:37.969110 8637 catalog_manager.cc:4841] TS 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889): tablet 73ab1be500c54f5390c4d67adfe5d105 (table test-table [id=248687c74fe8432186729d2ab963d31c]) successfully deleted
I20260812 11:23:37.969372 8637 catalog_manager.cc:4841] TS d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667): tablet 73ab1be500c54f5390c4d67adfe5d105 (table test-table [id=248687c74fe8432186729d2ab963d31c]) successfully deleted
W20260812 11:23:37.975958 8632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:45575 (error 108)
I20260812 11:23:37.976370 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 9062
I20260812 11:23:37.977113 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:37.976751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:45575 (local address 127.0.0.1:42346)
0812 11:23:37.976930 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:37.977012 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:45575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260812 11:23:37.977321 8632 catalog_manager.cc:4584] TS 5ac6d0de48fb46d28f8cfa36c58f1c92 (127.12.175.193:45575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 73ab1be500c54f5390c4d67adfe5d105: Network error: Client connection negotiation failed: client connection to 127.12.175.193:45575: connect: Connection refused (error 111)
I20260812 11:23:37.983440 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 9384
I20260812 11:23:37.997650 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 8590
I20260812 11:23:38.013381 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42705
--webserver_interface=127.12.175.254
--webserver_port=32837
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:42705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:38.118736 9723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:38.118961 9723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:38.119014 9723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:38.122864 9723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:38.122916 9723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:38.122943 9723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:38.122973 9723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:38.123000 9723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:38.127931 9723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:42705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=32837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:38.128762 9723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:38.129628 9723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:38.137419 9731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.137430 9732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:38.137482 9723 server_base.cc:1034] running on GCE node
W20260812 11:23:38.137435 9735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:38.138248 9723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:38.139163 9723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:38.140316 9723 hybrid_clock.cc:648] HybridClock initialized: now 1786533818140300 us; error 28 us; skew 500 ppm
Aug 12 11:23:38 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533818, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:38.142827 9723 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:38.143659 9723 webserver.cc:460] Webserver started at http://127.12.175.254:32837/ using document root <none> and password file <none>
I20260812 11:23:38.144155 9723 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:38.144213 9723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:38.147598 9723 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:23:38.149430 9744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.150535 9723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:38.150664 9723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "e009d0cdad0f4c60a3a3dbbf468b9899"
format_stamp: "Formatted at 2026-08-12 11:23:35 on dist-test-slave-gjrz"
server_key: "054f55d35f140d55b04dfee82c3f9691"
server_key_iv: "ab41d3a45c4cc0281897d3d6f3631b55"
server_key_version: "encryptionkey@0"
I20260812 11:23:38.151122 9723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:38.172537 9723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:38.175001 9723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:38.175161 9723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:38.181711 9723 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:42705
I20260812 11:23:38.181977 9852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:42705 every 8 connection(s)
I20260812 11:23:38.182713 9723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:38.186722 9853 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:23:38.188314 9853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap starting.
I20260812 11:23:38.188813 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 9723
I20260812 11:23:38.189217 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:45575
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:42705
--webserver_port=44615
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:38.205015 9853 log.cc:824] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:38.215756 9853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:23:38.216063 9853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899: Bootstrap complete.
I20260812 11:23:38.219753 9853 raft_consensus.cc:348] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:38.220134 9853 raft_consensus.cc:729] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e009d0cdad0f4c60a3a3dbbf468b9899, State: Initialized, Role: FOLLOWER
I20260812 11:23:38.220575 9853 consensus_queue.cc:260] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:38.220696 9853 raft_consensus.cc:388] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:38.220765 9853 raft_consensus.cc:482] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:38.220855 9853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:23:38.222576 9853 raft_consensus.cc:504] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:38.222867 9853 leader_election.cc:302] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e009d0cdad0f4c60a3a3dbbf468b9899; no voters:
I20260812 11:23:38.223158 9853 leader_election.cc:288] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:23:38.223292 9862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:23:38.223533 9862 raft_consensus.cc:686] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [term 3 LEADER]: Becoming Leader. State: Replica: e009d0cdad0f4c60a3a3dbbf468b9899, State: Running, Role: LEADER
I20260812 11:23:38.223908 9862 consensus_queue.cc:237] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } }
I20260812 11:23:38.224257 9853 sys_catalog.cc:564] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:38.225332 9865 sys_catalog.cc:455] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e009d0cdad0f4c60a3a3dbbf468b9899. Latest consensus state: current_term: 3 leader_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } } }
I20260812 11:23:38.225333 9863 sys_catalog.cc:455] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e009d0cdad0f4c60a3a3dbbf468b9899" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42705 } } }
I20260812 11:23:38.225467 9865 sys_catalog.cc:458] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:38.225481 9863 sys_catalog.cc:458] T 00000000000000000000000000000000 P e009d0cdad0f4c60a3a3dbbf468b9899 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:38.226095 9880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:38.230966 9880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:38.231635 9880 catalog_manager.cc:1259] Loaded cluster ID: 3c07d49c76e541b1ac314486c23aac89
I20260812 11:23:38.231695 9880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 11:23:38.232690 9880 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe0e19e79ad google::LogMessage::Fail() at ??:0
@ 0x7fe0e19ea88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe0e19e74de google::LogMessage::Flush() at ??:0
@ 0x7fe0e19e8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe0ec326fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fe0ec327d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe0ec324579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fe0ec368640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe0e3c393d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe0e3c39c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fe0e3c3b3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe0e3c2a512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe0e526e6db start_thread at ??:0
@ 0x7fe0e04e561f clone at ??:0
W20260812 11:23:38.320384 9860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:38.320588 9860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:38.320627 9860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:38.324473 9860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:38.324519 9860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:38.324573 9860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:23:38.329452 9860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:45575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=44615
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:38.330345 9860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:38.331234 9860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:38.340025 9936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.340092 9942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.340086 9945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:38.340456 9860 server_base.cc:1034] running on GCE node
I20260812 11:23:38.340823 9860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:38.341395 9860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:38.342553 9860 hybrid_clock.cc:648] HybridClock initialized: now 1786533818342535 us; error 40 us; skew 500 ppm
Aug 12 11:23:38 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533818, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:38.345111 9860 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:23:38.345942 9860 webserver.cc:460] Webserver started at http://127.12.175.193:44615/ using document root <none> and password file <none>
I20260812 11:23:38.346446 9860 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:38.346513 9860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:38.350085 9860 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:38.352031 9959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.353192 9860 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:38.353281 9860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "4707ecf130ec0a9e6808c2ca449b34ee"
server_key_iv: "d8d4bfb7d1601d397f1aea04de465638"
server_key_version: "encryptionkey@0"
I20260812 11:23:38.353771 9860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:38.374040 9860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:38.376838 9860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:38.377003 9860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:38.377540 9860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:38.378623 9973 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:23:38.383816 9860 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:23:38.383876 9860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260812 11:23:38.383936 9860 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:23:38.385499 9860 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:23:38.385542 9860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 11:23:38.385908 9973 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap starting.
I20260812 11:23:38.395138 9860 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:45575
I20260812 11:23:38.395216 10190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:45575 every 8 connection(s)
I20260812 11:23:38.396060 9860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:23:38.406148 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 9860
I20260812 11:23:38.406541 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:33889
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:42705
--webserver_port=41829
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:38.406919 9973 log.cc:824] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:38.415691 9973 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:23:38.416074 9973 tablet_bootstrap.cc:492] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Bootstrap complete.
I20260812 11:23:38.417393 9973 ts_tablet_manager.cc:1397] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent bootstrapping tablet: real 0.032s user 0.018s sys 0.011s
I20260812 11:23:38.420471 9973 raft_consensus.cc:348] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:38.420982 9973 raft_consensus.cc:729] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac6d0de48fb46d28f8cfa36c58f1c92, State: Initialized, Role: FOLLOWER
I20260812 11:23:38.421468 9973 consensus_queue.cc:260] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:38.422555 9973 ts_tablet_manager.cc:1428] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
W20260812 11:23:38.438916 10195 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:38.397712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:59413)
0812 11:23:38.398158 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.398206 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:38.398953 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:38.438033 (+ 39080us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":121,"threads_started":1}
W20260812 11:23:38.439435 10191 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:42705 (0 consecutive failures): Network error: Failed to ping master at 127.12.175.254:42705: Client connection negotiation failed: client connection to 127.12.175.254:42705: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:23:38.440135 10195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.439870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:57327)
0812 11:23:38.440000 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.440070 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 11:23:38.440724 10195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.440511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:58397)
0812 11:23:38.440619 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.440667 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 11:23:38.440899 10191 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:23:38.518713 10201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:38.518915 10201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:38.518952 10201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:38.522727 10201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:38.522770 10201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:38.522822 10201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:23:38.527606 10201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:33889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=41829
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:38.528384 10201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:38.529192 10201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:38.537698 10209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.537751 10214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.537703 10210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:38.538013 10201 server_base.cc:1034] running on GCE node
I20260812 11:23:38.538363 10201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:38.538909 10201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:38.540055 10201 hybrid_clock.cc:648] HybridClock initialized: now 1786533818540038 us; error 28 us; skew 500 ppm
Aug 12 11:23:38 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533818, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:38.542549 10201 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:23:38.543362 10201 webserver.cc:460] Webserver started at http://127.12.175.194:41829/ using document root <none> and password file <none>
I20260812 11:23:38.543849 10201 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:38.543913 10201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:38.547442 10201 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 11:23:38.549266 10226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.550309 10201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:38.550411 10201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "58cc537e88234b36a9bc036965a0fc44"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "03390e77e55a1648f62b2a522d607d43"
server_key_iv: "47d766ea52d5e235129061512bcd973a"
server_key_version: "encryptionkey@0"
I20260812 11:23:38.550871 10201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:38.563118 10201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:38.565783 10201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:38.565937 10201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:38.566435 10201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:38.567150 10201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:38.567198 10201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.567232 10201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:38.567247 10201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.574916 10201 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:33889
I20260812 11:23:38.575029 10439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:33889 every 8 connection(s)
I20260812 11:23:38.575812 10201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:23:38.579064 10448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.577643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:43963)
0812 11:23:38.578042 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.578439 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":110,"threads_started":1}
W20260812 11:23:38.579450 10442 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:42705 (0 consecutive failures): Network error: Failed to ping master at 127.12.175.254:42705: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
I20260812 11:23:38.579923 10448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.579744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:40835)
0812 11:23:38.579829 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.579871 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 11:23:38.580389 10448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.580231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:52489)
0812 11:23:38.580306 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.580342 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 11:23:38.580529 10442 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:23:38.585024 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 10201
I20260812 11:23:38.585367 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:42667
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:42705
--webserver_port=33907
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:38.691973 10450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:38.692198 10450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:38.692253 10450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:38.696105 10450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:38.696157 10450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:38.696226 10450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:23:38.701169 10450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:42667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=33907
--tserver_master_addrs=127.12.175.254:42705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:38.702061 10450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:38.702951 10450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:38.711702 10471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.711716 10462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:38.711757 10467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:38.711961 10450 server_base.cc:1034] running on GCE node
I20260812 11:23:38.712337 10450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:38.712939 10450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:38.714087 10450 hybrid_clock.cc:648] HybridClock initialized: now 1786533818714064 us; error 34 us; skew 500 ppm
Aug 12 11:23:38 dist-test-slave-gjrz krb5kdc[7445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533818, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:38.716569 10450 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:23:38.717370 10450 webserver.cc:460] Webserver started at http://127.12.175.195:33907/ using document root <none> and password file <none>
I20260812 11:23:38.717860 10450 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:38.717918 10450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:38.721433 10450 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:23:38.723313 10485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.724411 10450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:38.724514 10450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "d942588183a7491ea5042fd9512f3b7d"
format_stamp: "Formatted at 2026-08-12 11:23:36 on dist-test-slave-gjrz"
server_key: "c86c66280650a04234201466a105e824"
server_key_iv: "916af0e77c053c01c868ee591688a61d"
server_key_version: "encryptionkey@0"
I20260812 11:23:38.724988 10450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:38.734068 10450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:38.736603 10450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:38.736759 10450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:38.737298 10450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:38.738039 10450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:38.738095 10450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.738145 10450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:38.738171 10450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:38.746575 10450 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:42667
I20260812 11:23:38.746605 10716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:42667 every 8 connection(s)
I20260812 11:23:38.747511 10450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:23:38.751005 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.749360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:51541)
0812 11:23:38.749768 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.749871 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":121,"threads_started":1}
W20260812 11:23:38.751446 10717 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:42705 (0 consecutive failures): Network error: Failed to ping master at 127.12.175.254:42705: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
I20260812 11:23:38.751487 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 10450
I20260812 11:23:38.751999 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.751799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:55169)
0812 11:23:38.751902 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.751947 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 11:23:38.752560 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:38.752358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:45323)
0812 11:23:38.752450 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:38.752494 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 11:23:38.752710 10717 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:23:39.441804 10728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.441410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:37769)
0812 11:23:39.441652 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:39.441701 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
I20260812 11:23:39.581391 10729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.580978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:33701)
0812 11:23:39.581237 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:39.581298 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":68,"threads_started":1}
I20260812 11:23:39.655560 10730 raft_consensus.cc:482] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:39.655754 10730 raft_consensus.cc:504] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:39.656847 10730 leader_election.cc:288] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889), d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
Aug 12 11:23:39 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533818, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.195@KRBTEST.COM
Aug 12 11:23:39 dist-test-slave-gjrz krb5kdc[7445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533818, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.194@KRBTEST.COM
I20260812 11:23:39.678023 10728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.657028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:33889 (local address 127.12.175.193:42247)
0812 11:23:39.657143 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:39.657157 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:39.657263 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:39.659427 (+ 2164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:39.659434 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:39.660038 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:39.660847 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:39.660868 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.662732 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.662735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:39.664220 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:39.664232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.665185 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.665189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:39.665454 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:39.671119 (+ 5665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:39.671146 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:39.673373 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:39.675601 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:39.675604 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:39.675606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:39.675812 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:39.676159 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:39.676162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:39.676164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:39.676242 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:39.676931 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:39.676937 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:39.677286 (+ 349us) client_negotiation.cc:769] Sending connection context
0812 11:23:39.677490 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 11:23:39.677869 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":389,"spinlock_wait_cycles":31104}
I20260812 11:23:39.678098 10739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.657468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:49841 (local address 127.12.175.195:42667)
0812 11:23:39.657863 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:39.657876 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:39.657914 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:23:39.658692 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:39.658700 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:39.658988 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:39.659333 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:39.661021 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.662594 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.664355 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.665073 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.665241 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:39.673262 (+ 8021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:39.673268 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:39.673284 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:39.673319 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:39.675237 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:39.675781 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:39.675786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:39.675791 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:39.675937 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:39.676303 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:39.676306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:39.676308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:39.676813 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:39.676945 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:39.677636 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 11:23:39.677917 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":144,"threads_started":1}
I20260812 11:23:39.678100 10731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.657164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:42247 (local address 127.12.175.194:33889)
0812 11:23:39.657541 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:39.657565 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:39.657615 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:23:39.658525 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:39.658536 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:39.658990 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:39.659333 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:39.661021 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.662594 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.664355 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.665080 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.665241 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:39.673582 (+ 8341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:39.673589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:39.673604 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:39.673640 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:39.675500 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:39.675919 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:39.675925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:39.675930 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:39.676074 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:39.676321 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:39.676324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:39.676325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:39.676813 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:39.676945 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:39.677636 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 11:23:39.677917 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":58,"threads_started":1}
I20260812 11:23:39.678032 10736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.657290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:42667 (local address 127.12.175.193:49841)
0812 11:23:39.657583 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:39.657598 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:39.657728 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:39.659427 (+ 1699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:39.659433 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:39.660038 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:39.660847 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:39.660868 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.662732 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.662735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:39.664221 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:39.664232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:39.665185 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:39.665189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:39.665454 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:39.671119 (+ 5665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:39.671146 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:39.673026 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:39.675376 (+ 2350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:39.675380 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:39.675392 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:39.675666 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:39.676037 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:39.676039 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:39.676040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:39.676204 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:39.676931 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:39.676937 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:39.677286 (+ 349us) client_negotiation.cc:769] Sending connection context
0812 11:23:39.677490 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 11:23:39.677806 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":351,"spinlock_wait_cycles":30976,"thread_start_us":79,"threads_started":1}
W20260812 11:23:39.680590 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
W20260812 11:23:39.681250 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:39.681324 9966 leader_election.cc:302] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92; no voters: 58cc537e88234b36a9bc036965a0fc44, d942588183a7491ea5042fd9512f3b7d
I20260812 11:23:39.681561 10730 raft_consensus.cc:2726] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:23:39.753486 10743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:39.753143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:46155)
0812 11:23:39.753348 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:39.753395 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":79,"threads_started":1}
I20260812 11:23:40.442812 10744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:40.442445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:40449)
0812 11:23:40.442671 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:40.442722 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":69,"threads_started":1}
I20260812 11:23:40.582372 10745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:40.582002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:38687)
0812 11:23:40.582237 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:40.582289 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260812 11:23:40.754415 10746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:40.754039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:41173)
0812 11:23:40.754263 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:40.754313 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260812 11:23:41.319582 10751 raft_consensus.cc:482] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:41.319702 10751 raft_consensus.cc:504] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:41.320060 10751 leader_election.cc:288] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889), d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
W20260812 11:23:41.320870 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
W20260812 11:23:41.321053 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:41.321113 9966 leader_election.cc:302] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92; no voters: 58cc537e88234b36a9bc036965a0fc44, d942588183a7491ea5042fd9512f3b7d
I20260812 11:23:41.321267 10751 raft_consensus.cc:2726] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:23:41.443819 10755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:41.443470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:55551)
0812 11:23:41.443683 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:41.443731 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":70,"threads_started":1}
I20260812 11:23:41.583380 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:41.582981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:45399)
0812 11:23:41.583205 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:41.583251 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260812 11:23:41.755470 10758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:41.755081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:38197)
0812 11:23:41.755325 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:41.755377 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":68,"threads_started":1}
I20260812 11:23:42.444859 10759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:42.444461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:53651)
0812 11:23:42.444707 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:42.444763 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":83,"threads_started":1}
I20260812 11:23:42.584333 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:42.583969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:60563)
0812 11:23:42.584199 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:42.584248 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":89,"threads_started":1}
I20260812 11:23:42.756487 10761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:42.756074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:57273)
0812 11:23:42.756336 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:42.756398 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":91,"threads_started":1}
I20260812 11:23:43.446086 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:43.445639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:59537)
0812 11:23:43.445935 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:43.445991 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":72,"threads_started":1}
I20260812 11:23:43.585377 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:43.584989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:53057)
0812 11:23:43.585239 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:43.585290 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":88,"threads_started":1}
I20260812 11:23:43.757520 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:43.757113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:37185)
0812 11:23:43.757361 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:43.757413 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":92,"threads_started":1}
I20260812 11:23:44.447063 10766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:44.446680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:53197)
0812 11:23:44.446914 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:44.446967 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":74,"threads_started":1}
I20260812 11:23:44.559621 10767 raft_consensus.cc:482] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:44.559742 10767 raft_consensus.cc:504] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:44.560110 10767 leader_election.cc:288] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889), d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
W20260812 11:23:44.560853 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
W20260812 11:23:44.561007 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:44.561069 9966 leader_election.cc:302] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92; no voters: 58cc537e88234b36a9bc036965a0fc44, d942588183a7491ea5042fd9512f3b7d
I20260812 11:23:44.561221 10767 raft_consensus.cc:2726] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:23:44.586318 10768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:44.585968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:52905)
0812 11:23:44.586186 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:44.586234 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":78,"threads_started":1}
I20260812 11:23:44.758580 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:44.758183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:51645)
0812 11:23:44.758417 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:44.758469 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":89,"threads_started":1}
I20260812 11:23:45.448179 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:45.447759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:51437)
0812 11:23:45.448026 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:45.448082 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":94,"threads_started":1}
I20260812 11:23:45.587419 10776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:45.586918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:32775)
0812 11:23:45.587240 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:45.587329 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":104,"threads_started":1}
I20260812 11:23:45.759593 10777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:45.759165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:38187)
0812 11:23:45.759457 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:45.759506 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":88,"threads_started":1}
I20260812 11:23:46.449249 10781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:46.448850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:36553)
0812 11:23:46.449101 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:46.449153 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":94,"threads_started":1}
I20260812 11:23:46.588423 10785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:46.588033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:43083)
0812 11:23:46.588281 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:46.588339 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":70,"threads_started":1}
I20260812 11:23:46.760608 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:46.760223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:41639)
0812 11:23:46.760468 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:46.760521 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":70,"threads_started":1}
I20260812 11:23:47.450258 10789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:47.449883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:52909)
0812 11:23:47.450112 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:47.450163 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":83,"threads_started":1}
I20260812 11:23:47.589440 10790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:47.589066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:47747)
0812 11:23:47.589305 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:47.589353 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
I20260812 11:23:47.761585 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:47.761193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:57679)
0812 11:23:47.761428 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:47.761484 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260812 11:23:48.451519 10794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:48.451070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:37859)
0812 11:23:48.451361 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:48.451416 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":75,"threads_started":1}
I20260812 11:23:48.590560 10795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:48.590171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:33033)
0812 11:23:48.590420 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:48.590474 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":71,"threads_started":1}
I20260812 11:23:48.647675 10796 raft_consensus.cc:482] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:48.647797 10796 raft_consensus.cc:504] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58cc537e88234b36a9bc036965a0fc44" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 33889 } } peers { permanent_uuid: "d942588183a7491ea5042fd9512f3b7d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 42667 } } peers { permanent_uuid: "5ac6d0de48fb46d28f8cfa36c58f1c92" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 45575 } }
I20260812 11:23:48.648145 10796 leader_election.cc:288] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889), d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667)
W20260812 11:23:48.648906 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 58cc537e88234b36a9bc036965a0fc44 (127.12.175.194:33889): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
W20260812 11:23:48.649044 9966 leader_election.cc:341] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d942588183a7491ea5042fd9512f3b7d (127.12.175.195:42667): Not found: Tablet not found: 73ab1be500c54f5390c4d67adfe5d105
I20260812 11:23:48.649093 9966 leader_election.cc:302] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ac6d0de48fb46d28f8cfa36c58f1c92; no voters: 58cc537e88234b36a9bc036965a0fc44, d942588183a7491ea5042fd9512f3b7d
I20260812 11:23:48.649248 10796 raft_consensus.cc:2726] T 73ab1be500c54f5390c4d67adfe5d105 P 5ac6d0de48fb46d28f8cfa36c58f1c92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:23:48.762588 10797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:48.762222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:56573)
0812 11:23:48.762450 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:48.762500 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260812 11:23:49.452590 10798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:49.452202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:45285)
0812 11:23:49.452433 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:49.452485 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":74,"threads_started":1}
I20260812 11:23:49.591677 10803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:49.591285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:39837)
0812 11:23:49.591536 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:49.591587 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":67,"threads_started":1}
I20260812 11:23:49.763618 10806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:49.763226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:42577)
0812 11:23:49.763475 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:49.763526 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":100,"threads_started":1}
I20260812 11:23:50.453722 10812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:50.453303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:49913)
0812 11:23:50.453548 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:50.453601 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":78,"threads_started":1}
I20260812 11:23:50.592707 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:50.592290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:59721)
0812 11:23:50.592560 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:50.592615 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":86,"threads_started":1}
I20260812 11:23:50.764674 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:50.764250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:55327)
0812 11:23:50.764523 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:50.764580 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":73,"threads_started":1}
I20260812 11:23:51.454811 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:51.454377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:53961)
0812 11:23:51.454628 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:51.454707 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":87,"threads_started":1}
I20260812 11:23:51.593713 10821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:51.593340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:37853)
0812 11:23:51.593572 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:51.593624 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":75,"threads_started":1}
I20260812 11:23:51.765632 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:51.765283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:60951)
0812 11:23:51.765493 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:51.765547 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":72,"threads_started":1}
I20260812 11:23:52.455945 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:52.455511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:39471)
0812 11:23:52.455760 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:52.455814 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
I20260812 11:23:52.594678 10827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:52.594318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:40519)
0812 11:23:52.594541 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:52.594590 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260812 11:23:52.766633 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:52.766232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:49357)
0812 11:23:52.766492 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:52.766544 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
I20260812 11:23:53.457130 10832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:53.456742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.193:48567)
0812 11:23:53.456983 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:53.457034 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":94,"threads_started":1}
I20260812 11:23:53.595804 10835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:53.595425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.194:42601)
0812 11:23:53.595671 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:53.595719 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
I20260812 11:23:53.753288 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 9860
I20260812 11:23:53.767760 10836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:53.767397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42705 (local address 127.12.175.195:60403)
0812 11:23:53.767621 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:53.767671 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:42705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":61,"threads_started":1}
I20260812 11:23:53.771443 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 10201
I20260812 11:23:53.781584 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 10450
2026-08-12T11:23:53Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20200 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:53 dist-test-slave-gjrz krb5kdc[10843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:53 dist-test-slave-gjrz krb5kdc[10843](info): set up 2 sockets
Aug 12 11:23:53 dist-test-slave-gjrz krb5kdc[10843](info): commencing operation
krb5kdc: starting...
W20260812 11:23:54.986155 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:23:55.099658 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43923
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:43923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:55.204177 10870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:55.204389 10870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:55.204425 10870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:55.208190 10870 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:23:55.208225 10870 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:23:55.208238 10870 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:23:55.208250 10870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:55.208268 10870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:55.208290 10870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:55.208305 10870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:55.208321 10870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:55.213124 10870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:43923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:55.213901 10870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:55.214723 10870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:23:55.222497 10870 server_base.cc:1034] running on GCE node
W20260812 11:23:55.222604 10882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:55.222671 10878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:55.222592 10880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:55.223362 10870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:55.224349 10870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:55.225497 10870 hybrid_clock.cc:648] HybridClock initialized: now 1786533835225479 us; error 37 us; skew 500 ppm
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:55.228066 10870 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:23:55.228824 10870 webserver.cc:460] Webserver started at http://127.12.175.254:40283/ using document root <none> and password file <none>
I20260812 11:23:55.229278 10870 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:55.229331 10870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:55.229482 10870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:55.231256 10870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "1ddb93046eb445529026a232cb9a0296"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "e76e7e6721ff8d33e12807fc44b8def1"
server_key_iv: "19d0f3af759fca04eda61b3bf1157ba3"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.231802 10870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "1ddb93046eb445529026a232cb9a0296"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "e76e7e6721ff8d33e12807fc44b8def1"
server_key_iv: "19d0f3af759fca04eda61b3bf1157ba3"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.235064 10870 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:23:55.237232 10902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.238291 10870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:23:55.238389 10870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "1ddb93046eb445529026a232cb9a0296"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "e76e7e6721ff8d33e12807fc44b8def1"
server_key_iv: "19d0f3af759fca04eda61b3bf1157ba3"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.238464 10870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:55.254611 10870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:55.257313 10870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:55.257452 10870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:55.263569 10870 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:43923
I20260812 11:23:55.263878 10992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:43923 every 8 connection(s)
I20260812 11:23:55.264458 10870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:55.266950 10993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:55.271991 10993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap starting.
I20260812 11:23:55.274189 10993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:55.274530 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 10870
I20260812 11:23:55.274652 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:23:55.274910 12991 external_mini_cluster.cc:1428] Setting key cd44544d0bd5a719cb022dd66e92f4db
I20260812 11:23:55.274907 10993 log.cc:824] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:55.276899 10993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: No bootstrap required, opened a new log
I20260812 11:23:55.281044 10993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:23:55.281289 10993 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:55.281344 10993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ddb93046eb445529026a232cb9a0296, State: Initialized, Role: FOLLOWER
I20260812 11:23:55.281803 10993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:23:55.281970 10993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:55.282038 10993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:55.282141 10993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:55.282923 10993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:23:55.283308 10993 leader_election.cc:302] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ddb93046eb445529026a232cb9a0296; no voters:
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:55.283677 10993 leader_election.cc:288] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:23:55.283771 11007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:55.283972 11007 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 LEADER]: Becoming Leader. State: Replica: 1ddb93046eb445529026a232cb9a0296, State: Running, Role: LEADER
I20260812 11:23:55.284308 11007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:23:55.284904 10993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:55.285818 11012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ddb93046eb445529026a232cb9a0296" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } } }
I20260812 11:23:55.285946 11012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:55.286231 11013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ddb93046eb445529026a232cb9a0296. Latest consensus state: current_term: 1 leader_uuid: "1ddb93046eb445529026a232cb9a0296" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } } }
I20260812 11:23:55.286361 11013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:55.286691 11025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:55.289299 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.275882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60596 (local address 127.12.175.254:43923)
0812 11:23:55.276304 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.276323 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.276363 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:23:55.277127 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.277151 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.277540 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.277885 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:55.278481 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.279989 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.280823 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.281503 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.281659 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.284277 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:55.284283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:55.284298 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:55.284328 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:55.286283 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.286794 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.286800 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.286806 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.286950 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.287467 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.287471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.287473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.287888 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:55.288089 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.288355 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.288647 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":125,"threads_started":1}
I20260812 11:23:55.290496 11025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:55.295743 11025 catalog_manager.cc:1347] Generated new cluster ID: ef73ac83e5834d83a52b6bee8119dafc
I20260812 11:23:55.295792 11025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:55.303224 11025 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:55.304314 11025 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:55.312700 11025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Generated new TSK 0
I20260812 11:23:55.313341 11025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:23:55.343315 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43923
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:55.449476 11056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:55.449689 11056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:55.449728 11056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:55.453564 11056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:55.453613 11056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:55.453666 11056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:23:55.458565 11056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:55.459434 11056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:55.460326 11056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:55.469096 11063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:55.469221 11065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:55.469219 11062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:55.469318 11056 server_base.cc:1034] running on GCE node
I20260812 11:23:55.469827 11056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:55.470391 11056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:55.471536 11056 hybrid_clock.cc:648] HybridClock initialized: now 1786533835471511 us; error 36 us; skew 500 ppm
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:55.473985 11056 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:23:55.474750 11056 webserver.cc:460] Webserver started at http://127.12.175.193:35549/ using document root <none> and password file <none>
I20260812 11:23:55.475252 11056 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:55.475351 11056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:55.475544 11056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:55.477427 11056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "9b01be9ac27a4c0fbb94d8eb104315c1"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "db187ad8a21f1482b6fb2b1bb0897df2"
server_key_iv: "8a2da49ec066d443f44d86eedccf1a13"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.477952 11056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "9b01be9ac27a4c0fbb94d8eb104315c1"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "db187ad8a21f1482b6fb2b1bb0897df2"
server_key_iv: "8a2da49ec066d443f44d86eedccf1a13"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.481350 11056 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:23:55.483539 11079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.484638 11056 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 11:23:55.484742 11056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "9b01be9ac27a4c0fbb94d8eb104315c1"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "db187ad8a21f1482b6fb2b1bb0897df2"
server_key_iv: "8a2da49ec066d443f44d86eedccf1a13"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.484880 11056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:55.506704 11056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:55.509433 11056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:55.509598 11056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:55.510102 11056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:55.510846 11056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:55.510893 11056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.510941 11056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:55.510968 11056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.519116 11056 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:37469
I20260812 11:23:55.519145 11281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:37469 every 8 connection(s)
I20260812 11:23:55.519977 11056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:55.528604 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 11056
I20260812 11:23:55.528715 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:23:55.529032 12991 external_mini_cluster.cc:1428] Setting key f13250f288353ea89cd101319aa357d8
I20260812 11:23:55.532198 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.521527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:36093 (local address 127.12.175.254:43923)
0812 11:23:55.521676 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.521682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.522420 (+ 738us) server_negotiation.cc:407] Connection header received
0812 11:23:55.523679 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.523681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.523728 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.523800 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:55.524803 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.525326 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.526359 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.526575 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.526643 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.528827 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:55.528831 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:55.528834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:55.528862 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:55.530188 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.530694 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.530698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.530700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.530797 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.531101 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.531104 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.531105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.531332 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:55.531430 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.531919 (+ 489us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.532038 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:23:55.532945 11289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.521861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:36093)
0812 11:23:55.522285 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:55.522325 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:55.523481 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:55.523935 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:55.523942 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:55.524249 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:55.524689 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.524702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.525414 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.525416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.526268 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.526277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.526677 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.526680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.526805 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.527295 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:55.527318 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:55.528664 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:55.530299 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:55.530305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:55.530318 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:55.530598 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:55.530880 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:55.530882 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:55.530883 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:55.530998 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:55.531436 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:55.531441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:55.531691 (+ 250us) client_negotiation.cc:769] Sending connection context
0812 11:23:55.531855 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 11:23:55.532108 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":115,"threads_started":1}
I20260812 11:23:55.534001 11285 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43923
I20260812 11:23:55.534197 11285 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:55.534610 11285 heartbeater.cc:511] Master 127.12.175.254:43923 requested a full tablet report, sending...
I20260812 11:23:55.536109 10928 ts_manager.cc:194] Registered new tserver with Master: 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469)
I20260812 11:23:55.537607 10928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:36093
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:23:55.556126 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43923
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:55.660756 11292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:55.660965 11292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:55.661021 11292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:55.664919 11292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:55.664969 11292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:55.665045 11292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:23:55.669970 11292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:55.670902 11292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:55.671835 11292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:55.680511 11309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:55.680510 11304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:55.680768 11292 server_base.cc:1034] running on GCE node
W20260812 11:23:55.680524 11307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:55.681140 11292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:55.681691 11292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:55.682844 11292 hybrid_clock.cc:648] HybridClock initialized: now 1786533835682827 us; error 28 us; skew 500 ppm
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:55.685415 11292 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:23:55.686185 11292 webserver.cc:460] Webserver started at http://127.12.175.194:35105/ using document root <none> and password file <none>
I20260812 11:23:55.686686 11292 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:55.686750 11292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:55.686919 11292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:55.688864 11292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "24327dd197374a44ba40c10983b804da"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "83921a6fc122fa96ac538283b5cb6b91"
server_key_iv: "0108cfe0c0efa2f37c1d2a87f2e3a9eb"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.689365 11292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "24327dd197374a44ba40c10983b804da"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "83921a6fc122fa96ac538283b5cb6b91"
server_key_iv: "0108cfe0c0efa2f37c1d2a87f2e3a9eb"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.692727 11292 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 11:23:55.694902 11330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.696004 11292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:55.696105 11292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "24327dd197374a44ba40c10983b804da"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "83921a6fc122fa96ac538283b5cb6b91"
server_key_iv: "0108cfe0c0efa2f37c1d2a87f2e3a9eb"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.696194 11292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:55.710177 11292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:55.712857 11292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:55.713008 11292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:55.713487 11292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:55.714193 11292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:55.714239 11292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.714286 11292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:55.714315 11292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.722148 11292 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:39783
I20260812 11:23:55.722215 11539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:39783 every 8 connection(s)
I20260812 11:23:55.722882 11292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:55.731243 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 11292
I20260812 11:23:55.731396 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:23:55.731741 12991 external_mini_cluster.cc:1428] Setting key a9b83045eb08d0bc8679a8a99fe141bb
I20260812 11:23:55.734755 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.724420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:55965 (local address 127.12.175.254:43923)
0812 11:23:55.724542 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.724546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.725244 (+ 698us) server_negotiation.cc:407] Connection header received
0812 11:23:55.726373 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.726375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.726424 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.726493 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:55.727530 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.728056 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.729066 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.729269 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.729335 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.731451 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:55.731455 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:55.731458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:55.731488 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:55.732821 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.733365 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.733369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.733370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.733468 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.733753 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.733755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.733757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.733967 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:55.734079 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.734485 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.734604 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:23:55.735435 11545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.724703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:55965)
0812 11:23:55.725100 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:55.725138 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:55.726192 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:55.726630 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:55.726636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:55.726945 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:55.727412 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.727426 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.728144 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.728146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.728976 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.728984 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.729368 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.729370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.729497 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.729917 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:55.729933 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:55.731247 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:55.732957 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:55.732963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:55.732977 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:55.733266 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:55.733554 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:55.733557 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:55.733559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:55.733680 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:55.734075 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:55.734079 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:55.734282 (+ 203us) client_negotiation.cc:769] Sending connection context
0812 11:23:55.734423 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 11:23:55.734645 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":105,"threads_started":1}
I20260812 11:23:55.736426 11541 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43923
I20260812 11:23:55.736644 11541 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:55.737057 11541 heartbeater.cc:511] Master 127.12.175.254:43923 requested a full tablet report, sending...
I20260812 11:23:55.737991 10928 ts_manager.cc:194] Registered new tserver with Master: 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
I20260812 11:23:55.738513 10928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:55965
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:23:55.756367 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43923
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:55.865526 11554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:55.865736 11554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:55.865773 11554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:55.869685 11554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:55.869740 11554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:55.869792 11554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:23:55.874650 11554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:23:55.875505 11554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:55.876348 11554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:55.885164 11565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:55.885192 11563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:55.885223 11554 server_base.cc:1034] running on GCE node
W20260812 11:23:55.885202 11562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:55.885805 11554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:55.886364 11554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:55.887522 11554 hybrid_clock.cc:648] HybridClock initialized: now 1786533835887497 us; error 32 us; skew 500 ppm
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:55.890051 11554 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:23:55.890817 11554 webserver.cc:460] Webserver started at http://127.12.175.195:42011/ using document root <none> and password file <none>
I20260812 11:23:55.891317 11554 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:55.891381 11554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:55.891552 11554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:55.893337 11554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "1c69dde634f94401a6ae2770e74f8413"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "060969c42d77a8cf7ccc6b3ec494fd9a"
server_key_iv: "ca620d3d26ee3881de1168487f6e0f30"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.893816 11554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "1c69dde634f94401a6ae2770e74f8413"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "060969c42d77a8cf7ccc6b3ec494fd9a"
server_key_iv: "ca620d3d26ee3881de1168487f6e0f30"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.897118 11554 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:23:55.899279 11590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.900427 11554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:23:55.900550 11554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "1c69dde634f94401a6ae2770e74f8413"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "060969c42d77a8cf7ccc6b3ec494fd9a"
server_key_iv: "ca620d3d26ee3881de1168487f6e0f30"
server_key_version: "encryptionkey@0"
I20260812 11:23:55.900645 11554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:55.913215 11554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:55.915599 11554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:55.915733 11554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:55.916191 11554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:23:55.916899 11554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:23:55.916950 11554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.916992 11554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:23:55.917012 11554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:55.925079 11554 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:43647
I20260812 11:23:55.925105 11809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:43647 every 8 connection(s)
I20260812 11:23:55.925851 11554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:23:55.931330 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 11554
I20260812 11:23:55.931440 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:23:55.931701 12991 external_mini_cluster.cc:1428] Setting key 2c2343ee075d82e556e64114eebed7b0
Aug 12 11:23:55 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533835, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:23:55.937994 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.927437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:39461 (local address 127.12.175.254:43923)
0812 11:23:55.927580 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.927585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.928345 (+ 760us) server_negotiation.cc:407] Connection header received
0812 11:23:55.929513 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.929516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.929563 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.929633 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:55.930647 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.931160 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.932468 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.932749 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.932846 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.935062 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:55.935066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:55.935069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:55.935093 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:55.936183 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.936633 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.936637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.936639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.936714 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.937009 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.937012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.937014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.937185 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:55.937270 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.937727 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.937840 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:23:55.938657 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.927787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:39461)
0812 11:23:55.928199 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:55.928239 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:55.929334 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:55.929769 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:55.929776 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:55.930096 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:55.930523 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.930536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.931323 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.931325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.932351 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.932362 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.932885 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.932889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.933053 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.933601 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:55.933617 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:55.934906 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:55.936287 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:55.936293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:55.936306 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:55.936542 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:55.936796 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:55.936799 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:55.936801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:55.936923 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:55.937283 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:55.937289 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:55.937505 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 11:23:55.937668 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 11:23:55.937952 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":115,"threads_started":1}
I20260812 11:23:55.939631 11812 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43923
I20260812 11:23:55.939818 11812 heartbeater.cc:464] Registering TS with master...
I20260812 11:23:55.940225 11812 heartbeater.cc:511] Master 127.12.175.254:43923 requested a full tablet report, sending...
I20260812 11:23:55.941108 10928 ts_manager.cc:194] Registered new tserver with Master: 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647)
I20260812 11:23:55.941638 10928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:39461
I20260812 11:23:55.945091 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:23:55.953239 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.946849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60600 (local address 127.12.175.254:43923)
0812 11:23:55.946948 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.946951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.947123 (+ 172us) server_negotiation.cc:407] Connection header received
0812 11:23:55.947231 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.947234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.947293 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.947358 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:55.947987 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.948457 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.949244 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.949445 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.949527 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.950685 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:55.950689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:55.950691 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:55.950714 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:55.951786 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.952152 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.952156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.952158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.952230 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:55.952468 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:55.952471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:55.952473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:55.952672 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:55.952787 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.953006 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.953104 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 11:23:55.955680 10928 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:23:55.958431 10928 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:23:55.972033 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.966011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37469 (local address 127.0.0.1:43616)
0812 11:23:55.966324 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:55.966366 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:55.966480 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:55.968029 (+ 1549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:55.968032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:55.968051 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:55.968145 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.968151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.969151 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.969155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.970652 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.970663 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.971532 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.971536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.971641 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.971675 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:23:55.971778 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:23:55.971890 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":73,"thread_start_us":80,"threads_started":1}
I20260812 11:23:55.972301 11833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.966129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:39783 (local address 127.0.0.1:54778)
0812 11:23:55.966507 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:55.966521 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:55.966613 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:55.968264 (+ 1651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:55.968267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:55.968282 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:55.968362 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.968368 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.969618 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.969622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.970651 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.970663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.971919 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.971923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.972013 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.972035 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:23:55.972103 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:23:55.972171 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":6,"thread_start_us":100,"threads_started":1}
I20260812 11:23:55.972433 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.966831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35572 (local address 127.12.175.195:43647)
0812 11:23:55.967203 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.967214 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.967233 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:23:55.967321 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.967326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.967486 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.967692 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:55.967956 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.969024 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.970836 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.971612 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.971763 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.971857 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.972000 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.972102 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":88,"threads_started":1}
I20260812 11:23:55.972482 11840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.966900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43616 (local address 127.12.175.193:37469)
0812 11:23:55.967551 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.967562 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.967586 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:23:55.967665 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.967670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.967859 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.968042 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:55.968230 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.969021 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.970800 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.971412 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.971528 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.971664 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.972232 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.972331 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":144,"threads_started":1}
I20260812 11:23:55.972807 11843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.967350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54778 (local address 127.12.175.194:39783)
0812 11:23:55.967684 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:55.967695 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:55.967715 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:23:55.967789 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:55.967794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:55.967960 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:55.968116 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:55.968474 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.969469 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.970761 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.971617 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.971733 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.971856 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:55.972547 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 11:23:55.972674 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":113,"threads_started":1}
I20260812 11:23:55.975020 11412 tablet_service.cc:1467] Processing CreateTablet for tablet c058377578e946d6baf7fc443d41158f (DEFAULT_TABLE table=test-table [id=057857f8ba504e3b9401e171223ade66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:55.975025 11165 tablet_service.cc:1467] Processing CreateTablet for tablet c058377578e946d6baf7fc443d41158f (DEFAULT_TABLE table=test-table [id=057857f8ba504e3b9401e171223ade66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:55.975462 11834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:55.966694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:43647 (local address 127.0.0.1:35572)
0812 11:23:55.966985 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:55.966996 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:55.967100 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:55.967684 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:55.967690 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:55.967715 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:55.967827 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.967834 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.969204 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.969207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.970743 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:55.970751 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:55.971764 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:55.971767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:55.971859 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:55.971880 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:23:55.971966 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:23:55.972021 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":101,"thread_start_us":91,"threads_started":1}
I20260812 11:23:55.976006 11412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c058377578e946d6baf7fc443d41158f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:55.976006 11165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c058377578e946d6baf7fc443d41158f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:55.982163 11845 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Bootstrap starting.
I20260812 11:23:55.982061 11677 tablet_service.cc:1467] Processing CreateTablet for tablet c058377578e946d6baf7fc443d41158f (DEFAULT_TABLE table=test-table [id=057857f8ba504e3b9401e171223ade66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:23:55.982653 11844 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap starting.
I20260812 11:23:55.983011 11677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c058377578e946d6baf7fc443d41158f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:55.984913 11844 tablet_bootstrap.cc:654] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:55.985677 11845 tablet_bootstrap.cc:654] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:55.986222 11844 log.cc:824] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:55.986531 11845 log.cc:824] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:55.988258 11845 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: No bootstrap required, opened a new log
I20260812 11:23:55.988422 11844 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: No bootstrap required, opened a new log
I20260812 11:23:55.988447 11845 ts_tablet_manager.cc:1397] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:23:55.988619 11844 ts_tablet_manager.cc:1397] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:23:55.988874 11851 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Bootstrap starting.
I20260812 11:23:55.991496 11844 raft_consensus.cc:348] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:55.991673 11851 tablet_bootstrap.cc:654] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:55.991698 11844 raft_consensus.cc:374] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:55.991770 11844 raft_consensus.cc:729] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b01be9ac27a4c0fbb94d8eb104315c1, State: Initialized, Role: FOLLOWER
I20260812 11:23:55.992172 11844 consensus_queue.cc:260] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:55.992172 11845 raft_consensus.cc:348] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:55.992434 11845 raft_consensus.cc:374] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:55.992463 11851 log.cc:824] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:55.992496 11845 raft_consensus.cc:729] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24327dd197374a44ba40c10983b804da, State: Initialized, Role: FOLLOWER
I20260812 11:23:55.992903 11845 consensus_queue.cc:260] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:55.993108 11844 ts_tablet_manager.cc:1428] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 11:23:55.993189 11285 heartbeater.cc:503] Master 127.12.175.254:43923 was elected leader, sending a full tablet report...
I20260812 11:23:55.994330 11851 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: No bootstrap required, opened a new log
I20260812 11:23:55.994517 11851 ts_tablet_manager.cc:1397] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260812 11:23:55.994551 11541 heartbeater.cc:503] Master 127.12.175.254:43923 was elected leader, sending a full tablet report...
I20260812 11:23:55.994864 11845 ts_tablet_manager.cc:1428] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:23:55.998004 11851 raft_consensus.cc:348] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:55.998262 11851 raft_consensus.cc:374] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:55.998322 11851 raft_consensus.cc:729] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c69dde634f94401a6ae2770e74f8413, State: Initialized, Role: FOLLOWER
I20260812 11:23:55.998723 11851 consensus_queue.cc:260] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:55.999325 11812 heartbeater.cc:503] Master 127.12.175.254:43923 was elected leader, sending a full tablet report...
I20260812 11:23:55.999549 11851 ts_tablet_manager.cc:1428] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:23:56.000330 11852 raft_consensus.cc:482] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:23:56.000458 11852 raft_consensus.cc:504] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:56.001430 11852 leader_election.cc:288] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24327dd197374a44ba40c10983b804da (127.12.175.194:39783), 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647)
I20260812 11:23:56.005647 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:56.001749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:53057 (local address 127.12.175.195:43647)
0812 11:23:56.001843 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:56.001848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:56.002194 (+ 346us) server_negotiation.cc:407] Connection header received
0812 11:23:56.002333 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:56.002335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:56.002374 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:56.002447 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:56.002701 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.003387 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.004708 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.005159 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.005262 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:56.005308 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:56.005477 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 11:23:56.005541 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:23:56.005668 11858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:56.001616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:43647 (local address 127.12.175.193:53057)
0812 11:23:56.002116 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:56.002130 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:56.002245 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:56.002473 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:56.002476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:56.002494 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:56.002604 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:56.002610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.003480 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.003492 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:56.004617 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:56.004625 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.005265 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.005269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:56.005370 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:56.005392 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:23:56.005456 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:23:56.005534 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"mutex_wait_us":240,"thread_start_us":89,"threads_started":1}
I20260812 11:23:56.005738 11843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:56.001845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:47865 (local address 127.12.175.194:39783)
0812 11:23:56.001971 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:56.001975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:56.001987 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:23:56.002028 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:56.002031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:56.002072 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:56.002149 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:23:56.002389 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.003088 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.004650 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.005128 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.005252 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:56.005295 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:56.005568 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 11:23:56.005632 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:23:56.005760 11289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:56.001603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:39783 (local address 127.12.175.193:47865)
0812 11:23:56.001715 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:56.001729 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:56.001806 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:56.002164 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:56.002168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:56.002186 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:23:56.002296 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:56.002302 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.003221 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.003225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:56.004531 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:56.004542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.005350 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.005353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:56.005454 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:56.005470 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:23:56.005535 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:23:56.005617 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":3}
I20260812 11:23:56.006253 11451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c058377578e946d6baf7fc443d41158f" candidate_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24327dd197374a44ba40c10983b804da" is_pre_election: true
I20260812 11:23:56.006500 11451 raft_consensus.cc:2454] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b01be9ac27a4c0fbb94d8eb104315c1 in term 0.
I20260812 11:23:56.006564 11716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c058377578e946d6baf7fc443d41158f" candidate_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c69dde634f94401a6ae2770e74f8413" is_pre_election: true
I20260812 11:23:56.006805 11716 raft_consensus.cc:2454] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b01be9ac27a4c0fbb94d8eb104315c1 in term 0.
I20260812 11:23:56.006937 11084 leader_election.cc:302] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24327dd197374a44ba40c10983b804da, 9b01be9ac27a4c0fbb94d8eb104315c1; no voters:
I20260812 11:23:56.007179 11852 raft_consensus.cc:2781] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:23:56.007292 11852 raft_consensus.cc:482] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:23:56.007351 11852 raft_consensus.cc:3037] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:56.008195 11852 raft_consensus.cc:504] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:56.008464 11852 leader_election.cc:288] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 1 election: Requested vote from peers 24327dd197374a44ba40c10983b804da (127.12.175.194:39783), 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647)
I20260812 11:23:56.008772 11716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c058377578e946d6baf7fc443d41158f" candidate_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c69dde634f94401a6ae2770e74f8413"
I20260812 11:23:56.008769 11451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c058377578e946d6baf7fc443d41158f" candidate_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24327dd197374a44ba40c10983b804da"
I20260812 11:23:56.008865 11716 raft_consensus.cc:3037] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:56.008873 11451 raft_consensus.cc:3037] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:56.009738 11716 raft_consensus.cc:2454] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b01be9ac27a4c0fbb94d8eb104315c1 in term 1.
I20260812 11:23:56.009783 11451 raft_consensus.cc:2454] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b01be9ac27a4c0fbb94d8eb104315c1 in term 1.
I20260812 11:23:56.010015 11089 leader_election.cc:302] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c69dde634f94401a6ae2770e74f8413, 9b01be9ac27a4c0fbb94d8eb104315c1; no voters:
I20260812 11:23:56.010185 11852 raft_consensus.cc:2781] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:56.010377 11852 raft_consensus.cc:686] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9b01be9ac27a4c0fbb94d8eb104315c1, State: Running, Role: LEADER
I20260812 11:23:56.010649 11852 consensus_queue.cc:237] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:23:56.013224 10928 catalog_manager.cc:5495] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } health_report { overall_health: UNKNOWN } } }
W20260812 11:23:56.020943 11286 tablet.cc:2369] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:56.033599 11840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:56.030702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43620 (local address 127.12.175.193:37469)
0812 11:23:56.030813 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:56.030816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:56.030827 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:23:56.030948 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:56.030951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:56.030996 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:56.031075 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:56.031244 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.031742 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.032507 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:56.032707 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:56.032771 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:56.032972 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:56.033314 (+ 342us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:56.033395 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:56.033421 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 11:23:56.033463 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:23:56.038399 11716 raft_consensus.cc:1261] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Refusing update from remote peer 9b01be9ac27a4c0fbb94d8eb104315c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:56.038399 11451 raft_consensus.cc:1261] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Refusing update from remote peer 9b01be9ac27a4c0fbb94d8eb104315c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:56.039022 11861 consensus_queue.cc:1035] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:56.039175 11852 consensus_queue.cc:1035] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:56.046022 11868 mvcc.cc:205] Tried to move back new op lower bound from 7317642592407597056 to 7317642592301973504. Current Snapshot: MvccSnapshot[applied={T|T < 7317642592407597056}]
I20260812 11:23:56.048040 11873 mvcc.cc:205] Tried to move back new op lower bound from 7317642592407597056 to 7317642592301973504. Current Snapshot: MvccSnapshot[applied={T|T < 7317642592407597056}]
I20260812 11:23:56.053617 10928 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:56.053750 10928 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:23:56.055893 10928 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Sending DeleteTablet for 3 replicas of tablet c058377578e946d6baf7fc443d41158f
I20260812 11:23:56.056663 11412 tablet_service.cc:1514] Processing DeleteTablet for tablet c058377578e946d6baf7fc443d41158f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:56 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:54778
I20260812 11:23:56.056639 11165 tablet_service.cc:1514] Processing DeleteTablet for tablet c058377578e946d6baf7fc443d41158f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:56 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:43616
I20260812 11:23:56.056704 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 11056
I20260812 11:23:56.057427 11677 tablet_service.cc:1514] Processing DeleteTablet for tablet c058377578e946d6baf7fc443d41158f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:56 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:35572
I20260812 11:23:56.057145 11887 tablet_replica.cc:330] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: stopping tablet replica
I20260812 11:23:56.060005 11887 raft_consensus.cc:2229] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:56.060242 11887 raft_consensus.cc:2258] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:56.063284 11888 tablet_replica.cc:330] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: stopping tablet replica
I20260812 11:23:56.063632 11888 raft_consensus.cc:2229] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:23:56.063913 11887 ts_tablet_manager.cc:1905] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:56.063984 11888 raft_consensus.cc:2258] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:23:56.066794 11887 ts_tablet_manager.cc:1918] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:56.067613 11887 log.cc:1196] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/c058377578e946d6baf7fc443d41158f
I20260812 11:23:56.068007 11887 ts_tablet_manager.cc:1939] T c058377578e946d6baf7fc443d41158f P 24327dd197374a44ba40c10983b804da: Deleting consensus metadata
I20260812 11:23:56.070499 10905 catalog_manager.cc:4841] TS 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): tablet c058377578e946d6baf7fc443d41158f (table test-table [id=057857f8ba504e3b9401e171223ade66]) successfully deleted
I20260812 11:23:56.070695 11888 ts_tablet_manager.cc:1905] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:23:56.072928 11888 ts_tablet_manager.cc:1918] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:23:56.073045 11888 log.cc:1196] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/c058377578e946d6baf7fc443d41158f
I20260812 11:23:56.073300 11888 ts_tablet_manager.cc:1939] T c058377578e946d6baf7fc443d41158f P 1c69dde634f94401a6ae2770e74f8413: Deleting consensus metadata
I20260812 11:23:56.074258 10909 catalog_manager.cc:4841] TS 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): tablet c058377578e946d6baf7fc443d41158f (table test-table [id=057857f8ba504e3b9401e171223ade66]) successfully deleted
W20260812 11:23:56.076318 10909 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:37469 (error 108)
I20260812 11:23:56.076356 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 11292
I20260812 11:23:56.084527 11834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:56.084217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37469 (local address 127.0.0.1:43622)
0812 11:23:56.084376 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:56.084449 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260812 11:23:56.084707 10909 catalog_manager.cc:4584] TS 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c058377578e946d6baf7fc443d41158f: Network error: Client connection negotiation failed: client connection to 127.12.175.193:37469: connect: Connection refused (error 111)
I20260812 11:23:56.088734 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 11554
I20260812 11:23:56.099038 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 10870
I20260812 11:24:16.111178 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43923
--webserver_interface=127.12.175.254
--webserver_port=40283
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:43923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:16.221307 11894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:16.221529 11894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:16.221572 11894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:16.225436 11894 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:24:16.225478 11894 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:24:16.225492 11894 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:24:16.225508 11894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:24:16.225546 11894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:16.225575 11894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:16.225602 11894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:24:16.225631 11894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:24:16.230528 11894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:43923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=40283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:16.231467 11894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:16.232360 11894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:16.245200 11903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.245329 11911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.245139 11904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:16.245234 11894 server_base.cc:1034] running on GCE node
I20260812 11:24:16.245939 11894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:16.246989 11894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:16.248136 11894 hybrid_clock.cc:648] HybridClock initialized: now 1786533856248120 us; error 27 us; skew 500 ppm
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:16.253659 11894 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:24:16.254431 11894 webserver.cc:460] Webserver started at http://127.12.175.254:40283/ using document root <none> and password file <none>
I20260812 11:24:16.254940 11894 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:16.255007 11894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:16.258615 11894 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:16.260596 11923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.261660 11894 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:24:16.261763 11894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "1ddb93046eb445529026a232cb9a0296"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "e76e7e6721ff8d33e12807fc44b8def1"
server_key_iv: "19d0f3af759fca04eda61b3bf1157ba3"
server_key_version: "encryptionkey@0"
I20260812 11:24:16.262310 11894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:16.277817 11894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:16.280210 11894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:16.280362 11894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:16.286615 11894 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:43923
I20260812 11:24:16.286865 12012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:43923 every 8 connection(s)
I20260812 11:24:16.287612 11894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:24:16.288335 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 11894
I20260812 11:24:16.288821 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:37469
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:43923
--webserver_port=35549
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:24:16.292338 12013 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:24:16.293924 12013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap starting.
I20260812 11:24:16.310283 12013 log.cc:824] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:16.318487 12013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:24:16.318797 12013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap complete.
I20260812 11:24:16.322646 12013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:16.323027 12013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ddb93046eb445529026a232cb9a0296, State: Initialized, Role: FOLLOWER
I20260812 11:24:16.323539 12013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:16.323657 12013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:24:16.323727 12013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:24:16.323822 12013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:24:16.325613 12013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:16.325927 12013 leader_election.cc:302] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ddb93046eb445529026a232cb9a0296; no voters:
I20260812 11:24:16.326216 12013 leader_election.cc:288] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:24:16.326309 12018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:24:16.326515 12018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 LEADER]: Becoming Leader. State: Replica: 1ddb93046eb445529026a232cb9a0296, State: Running, Role: LEADER
I20260812 11:24:16.326862 12018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:16.327487 12013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:24:16.327832 12018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ddb93046eb445529026a232cb9a0296. Latest consensus state: current_term: 2 leader_uuid: "1ddb93046eb445529026a232cb9a0296" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } } }
I20260812 11:24:16.327955 12018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:16.328298 12019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1ddb93046eb445529026a232cb9a0296" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } } }
I20260812 11:24:16.328369 12025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:24:16.328472 12019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:16.333118 12025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:24:16.334009 12025 catalog_manager.cc:1259] Loaded cluster ID: ef73ac83e5834d83a52b6bee8119dafc
I20260812 11:24:16.334069 12025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:24:16.336506 12025 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:24:16.337222 12025 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Loaded TSK: 0
I20260812 11:24:16.372922 12025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Generated new TSK 1
I20260812 11:24:16.373200 12025 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:24:16.400733 12016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:16.400947 12016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:16.401002 12016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:16.404881 12016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:16.404927 12016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:16.405001 12016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:24:16.409925 12016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:37469
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=35549
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:16.410800 12016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:16.411716 12016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:16.421556 12061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.421732 12069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.421568 12060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:16.421976 12016 server_base.cc:1034] running on GCE node
I20260812 11:24:16.422353 12016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:16.422900 12016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:16.424074 12016 hybrid_clock.cc:648] HybridClock initialized: now 1786533856424055 us; error 33 us; skew 500 ppm
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:16.426724 12016 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:24:16.427562 12016 webserver.cc:460] Webserver started at http://127.12.175.193:35549/ using document root <none> and password file <none>
I20260812 11:24:16.428141 12016 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:16.428228 12016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:16.431993 12016 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:16.434048 12087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.435274 12016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:24:16.435387 12016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "9b01be9ac27a4c0fbb94d8eb104315c1"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "db187ad8a21f1482b6fb2b1bb0897df2"
server_key_iv: "8a2da49ec066d443f44d86eedccf1a13"
server_key_version: "encryptionkey@0"
I20260812 11:24:16.435875 12016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:16.450999 12016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:16.453819 12016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:16.453980 12016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:16.454484 12016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:16.455536 12099 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:24:16.459306 12016 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:24:16.459358 12016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260812 11:24:16.459404 12016 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:24:16.460937 12016 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:24:16.460990 12016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 11:24:16.461273 12099 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap starting.
I20260812 11:24:16.471184 12016 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:37469
I20260812 11:24:16.471331 12295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:37469 every 8 connection(s)
I20260812 11:24:16.472424 12016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:24:16.475865 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 12016
I20260812 11:24:16.476344 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:39783
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:43923
--webserver_port=35105
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:24:16.482096 12099 log.cc:824] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:16.489830 12099 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:24:16.490198 12099 tablet_bootstrap.cc:492] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap complete.
I20260812 11:24:16.491194 12099 ts_tablet_manager.cc:1397] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent bootstrapping tablet: real 0.030s user 0.016s sys 0.010s
I20260812 11:24:16.491564 12302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.474545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:40447)
0812 11:24:16.475243 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.475330 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.476379 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.478051 (+ 1672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.478060 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.478510 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:16.479113 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.479133 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.480799 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.480802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.482102 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.482114 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.483086 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.483090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.483306 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.483930 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:16.483950 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:16.485767 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:16.488166 (+ 2399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.488172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.488186 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.488538 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.488925 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.488928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.488929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.489119 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.489782 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:16.489788 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:16.490096 (+ 308us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.490301 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.490625 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":134,"threads_started":1}
I20260812 11:24:16.493055 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.474521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:40447 (local address 127.12.175.254:43923)
0812 11:24:16.474930 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.474964 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.475451 (+ 487us) server_negotiation.cc:407] Connection header received
0812 11:24:16.476810 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.476827 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.477186 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.477470 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:16.479313 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.480645 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.482280 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.482933 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.483109 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.485981 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:16.485987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:16.486002 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:16.486035 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:16.488037 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.488669 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.488675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.488680 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.488824 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.489222 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.489225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.489226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.489659 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:16.489790 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.492006 (+ 2216us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.492285 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":100,"threads_started":1}
I20260812 11:24:16.493448 12099 raft_consensus.cc:348] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:24:16.493832 12099 raft_consensus.cc:729] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b01be9ac27a4c0fbb94d8eb104315c1, State: Initialized, Role: FOLLOWER
I20260812 11:24:16.494359 12099 consensus_queue.cc:260] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } }
I20260812 11:24:16.495278 12099 ts_tablet_manager.cc:1428] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20260812 11:24:16.495321 12296 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43923
I20260812 11:24:16.495555 12296 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:16.495981 12296 heartbeater.cc:511] Master 127.12.175.254:43923 requested a full tablet report, sending...
I20260812 11:24:16.498129 11951 ts_manager.cc:194] Registered new tserver with Master: 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469)
I20260812 11:24:16.501437 11951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:40447
I20260812 11:24:16.504220 12296 heartbeater.cc:503] Master 127.12.175.254:43923 was elected leader, sending a full tablet report...
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.193@KRBTEST.COM
I20260812 11:24:16.509922 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.500753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35330 (local address 127.12.175.193:37469)
0812 11:24:16.501392 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.501403 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.501425 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:24:16.501485 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.501490 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.501670 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.501796 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:16.502462 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.503173 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.504075 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.504430 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.504529 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.506846 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:16.506854 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:16.506863 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:16.506884 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:16.508246 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.508739 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.508743 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.508744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.508812 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.509074 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.509076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.509077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.509272 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:16.509367 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.509693 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.509812 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":550,"thread_start_us":94,"threads_started":1}
I20260812 11:24:16.509987 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.500694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37469 (local address 127.0.0.1:35330)
0812 11:24:16.501057 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.501100 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.501212 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.501818 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.501824 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.502213 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:16.502332 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.502341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.503302 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.503305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.503887 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.503895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.504659 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.504662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.504745 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.505236 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:16.505251 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:16.506721 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:16.508351 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.508360 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.508365 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.508647 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.508886 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.508889 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.508891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.508995 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.509378 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:16.509383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:16.509498 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.509637 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.509806 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":92,"threads_started":1}
I20260812 11:24:16.510957 12171 tablet_service.cc:1514] Processing DeleteTablet for tablet c058377578e946d6baf7fc443d41158f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:23:56 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:35330
I20260812 11:24:16.511700 12313 tablet_replica.cc:330] stopping tablet replica
I20260812 11:24:16.511940 12313 raft_consensus.cc:2229] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:16.512148 12313 raft_consensus.cc:2258] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:16.512938 12313 ts_tablet_manager.cc:1905] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:16.516127 12313 ts_tablet_manager.cc:1918] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:16.516202 12313 log.cc:1196] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal/wals/c058377578e946d6baf7fc443d41158f
I20260812 11:24:16.516407 12313 ts_tablet_manager.cc:1939] T c058377578e946d6baf7fc443d41158f P 9b01be9ac27a4c0fbb94d8eb104315c1: Deleting consensus metadata
I20260812 11:24:16.517928 11929 catalog_manager.cc:4841] TS 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469): tablet c058377578e946d6baf7fc443d41158f (table test-table [id=057857f8ba504e3b9401e171223ade66]) successfully deleted
W20260812 11:24:16.592052 12305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:16.592263 12305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:16.592316 12305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:16.596144 12305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:16.596194 12305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:16.596267 12305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:24:16.601095 12305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:39783
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=35105
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:16.601940 12305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:16.602806 12305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:16.611405 12325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.611429 12319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.611469 12327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:16.611598 12305 server_base.cc:1034] running on GCE node
I20260812 11:24:16.612002 12305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:16.612561 12305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:16.613718 12305 hybrid_clock.cc:648] HybridClock initialized: now 1786533856613699 us; error 28 us; skew 500 ppm
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:16.616122 12305 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:24:16.616854 12305 webserver.cc:460] Webserver started at http://127.12.175.194:35105/ using document root <none> and password file <none>
I20260812 11:24:16.617334 12305 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:16.617414 12305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:16.620800 12305 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:16.622607 12345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.623745 12305 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:16.623847 12305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "24327dd197374a44ba40c10983b804da"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "83921a6fc122fa96ac538283b5cb6b91"
server_key_iv: "0108cfe0c0efa2f37c1d2a87f2e3a9eb"
server_key_version: "encryptionkey@0"
I20260812 11:24:16.624301 12305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:16.658505 12305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:16.660971 12305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:16.661129 12305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:16.661645 12305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:16.662412 12305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:16.662460 12305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.662511 12305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:16.662541 12305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.670717 12305 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:39783
I20260812 11:24:16.670745 12559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:39783 every 8 connection(s)
I20260812 11:24:16.671604 12305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:24:16.676143 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 12305
I20260812 11:24:16.676539 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:43647
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:43923
--webserver_port=42011
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:16.684427 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.673195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:36885 (local address 127.12.175.254:43923)
0812 11:24:16.673318 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.673321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.674060 (+ 739us) server_negotiation.cc:407] Connection header received
0812 11:24:16.675295 (+ 1235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.675298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.675358 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.675432 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:16.676535 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.677114 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.678292 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.678533 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.678613 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.681112 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:16.681115 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:16.681117 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:16.681143 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:16.682422 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.682990 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.682992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.682993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.683059 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.683425 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.683427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.683428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.683590 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:16.683662 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.684211 (+ 549us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.684310 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:24:16.685441 12563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.673511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:36885)
0812 11:24:16.673912 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.673950 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.675075 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.675616 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.675623 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.675940 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:16.676395 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.676411 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.677231 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.677235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.678150 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.678164 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.678667 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.678671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.678858 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.679367 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:16.679386 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:16.680940 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:16.682542 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.682549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.682563 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.682894 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.683136 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.683140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.683142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.683343 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.683686 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:16.683692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:16.683981 (+ 289us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.684191 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.684501 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":111,"threads_started":1}
I20260812 11:24:16.686560 12561 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43923
I20260812 11:24:16.686794 12561 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:16.687383 12561 heartbeater.cc:511] Master 127.12.175.254:43923 requested a full tablet report, sending...
I20260812 11:24:16.688463 11951 ts_manager.cc:194] Registered new tserver with Master: 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
I20260812 11:24:16.688987 11951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:36885
W20260812 11:24:16.785594 12564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:16.785804 12564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:16.785843 12564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:16.789656 12564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:16.789702 12564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:16.789762 12564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:24:16.794936 12564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:43647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=42011
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:16.795818 12564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:16.796705 12564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:16.805620 12571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.805619 12576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:16.805621 12573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:16.805706 12564 server_base.cc:1034] running on GCE node
I20260812 11:24:16.806227 12564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:16.806792 12564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:16.807945 12564 hybrid_clock.cc:648] HybridClock initialized: now 1786533856807923 us; error 36 us; skew 500 ppm
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:16.810416 12564 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:24:16.811203 12564 webserver.cc:460] Webserver started at http://127.12.175.195:42011/ using document root <none> and password file <none>
I20260812 11:24:16.811719 12564 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:16.811801 12564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:16.815196 12564 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:16.817106 12592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.818177 12564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:16.818279 12564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "1c69dde634f94401a6ae2770e74f8413"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "060969c42d77a8cf7ccc6b3ec494fd9a"
server_key_iv: "ca620d3d26ee3881de1168487f6e0f30"
server_key_version: "encryptionkey@0"
I20260812 11:24:16.818749 12564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:16.832753 12564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:16.835566 12564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:16.835717 12564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:16.836201 12564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:16.836920 12564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:16.836966 12564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.837013 12564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:16.837039 12564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:16.845419 12564 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:43647
I20260812 11:24:16.845429 12801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:43647 every 8 connection(s)
I20260812 11:24:16.846287 12564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:24:16.853446 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 12564
Aug 12 11:24:16 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533856, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:16.858511 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.847837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:47121 (local address 127.12.175.254:43923)
0812 11:24:16.847986 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.847991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.848715 (+ 724us) server_negotiation.cc:407] Connection header received
0812 11:24:16.849860 (+ 1145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.849862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.849908 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.849983 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:16.850980 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.851558 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.852589 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.852791 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.852858 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.855297 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:16.855302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:16.855305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:16.855331 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:16.856582 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.857116 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.857119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.857122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.857210 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.857517 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.857519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.857520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.857696 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:16.857785 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.858300 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.858398 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:24:16.859331 12809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.848184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:47121)
0812 11:24:16.848582 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.848620 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.849684 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.850128 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.850134 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.850433 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:16.850843 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.850855 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.851648 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.851651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.852498 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.852507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.852890 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.852893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.853024 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.853475 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:16.853491 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:16.855118 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:16.856700 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.856707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.856720 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.857042 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.857289 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:16.857291 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:16.857292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:16.857420 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:16.857796 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:16.857801 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:16.858055 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.858261 (+ 206us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.858578 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":102,"threads_started":1}
I20260812 11:24:16.860560 12803 heartbeater.cc:347] Connected to a master server at 127.12.175.254:43923
I20260812 11:24:16.860771 12803 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:16.861284 12803 heartbeater.cc:511] Master 127.12.175.254:43923 requested a full tablet report, sending...
I20260812 11:24:16.862314 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.854040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55810 (local address 127.12.175.254:43923)
0812 11:24:16.854262 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.854265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.854486 (+ 221us) server_negotiation.cc:407] Connection header received
0812 11:24:16.854624 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.854626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.854665 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.854753 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:16.855612 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.856094 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.857034 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.857364 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.857431 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.858848 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:16.858851 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:16.858853 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:16.858874 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:16.860332 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.860784 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.860787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.860789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.860880 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.861128 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.861131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.861133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.861333 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:16.861530 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.862084 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.862201 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":63,"threads_started":1}
I20260812 11:24:16.862331 11951 ts_manager.cc:194] Registered new tserver with Master: 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647)
I20260812 11:24:16.862928 11951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:47121
I20260812 11:24:16.863938 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:24:16.867781 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.864484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55820 (local address 127.12.175.254:43923)
0812 11:24:16.864578 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.864582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.864774 (+ 192us) server_negotiation.cc:407] Connection header received
0812 11:24:16.864925 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.864928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.865012 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.865106 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:24:16.865310 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.865907 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.866729 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.866971 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.867054 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.867349 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:24:16.867457 (+ 108us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 11:24:16.867682 (+ 225us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55820: token expired
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 11:24:16.867844 12812 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55820: token expired
W20260812 11:24:16.868145 11819 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.175.254:43923)
I20260812 11:24:16.874428 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.868452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55822 (local address 127.12.175.254:43923)
0812 11:24:16.868550 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.868554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.868566 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:24:16.868663 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.868666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.868700 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.868758 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:16.869299 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.869754 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.870497 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.870696 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.870775 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.871864 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:16.871867 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:16.871870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:16.871891 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:16.872997 (+ 1106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.873356 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.873359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.873361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.873433 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:16.873670 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:16.873674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:16.873675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:16.873827 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:16.873958 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.874204 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.874312 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:24:16.876435 11951 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:24:16.879417 11951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:24:16.886377 12171 tablet_service.cc:1467] Processing CreateTablet for tablet 23780b4cd8474a758f6c0e06abe541e3 (DEFAULT_TABLE table=test-table [id=5f6694e1ba334bb397671f1e4fa427c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:16.887018 12171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23780b4cd8474a758f6c0e06abe541e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:16.889559 12099 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap starting.
I20260812 11:24:16.890458 12099 tablet_bootstrap.cc:654] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:16.891124 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.885368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:43647 (local address 127.0.0.1:45672)
0812 11:24:16.885466 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.885479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.885550 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.886516 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.886520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.886540 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:16.886623 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.886630 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.888051 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.888054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.889312 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.889323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.890320 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.890323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.890815 (+ 492us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.890857 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.890928 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.891007 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":351}
I20260812 11:24:16.891191 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.885696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45672 (local address 127.12.175.195:43647)
0812 11:24:16.886040 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.886052 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.886089 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:24:16.886154 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.886159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.886341 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.886773 (+ 432us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:16.886914 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.887949 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.889447 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.890182 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.890459 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.890589 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.890976 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.891071 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":154,"threads_started":1}
I20260812 11:24:16.891940 12099 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: No bootstrap required, opened a new log
I20260812 11:24:16.892024 12099 ts_tablet_manager.cc:1397] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:24:16.892261 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.886140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:39783 (local address 127.0.0.1:42058)
0812 11:24:16.886384 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.886396 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.886480 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.888113 (+ 1633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.888116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.888136 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:16.888266 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.888273 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.889595 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.889598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.890746 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.890760 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.891853 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.891857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.891955 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.891978 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.892065 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.892131 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":59,"thread_start_us":61,"threads_started":1}
I20260812 11:24:16.892293 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.886316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.12.175.194:39783)
0812 11:24:16.887631 (+ 1315us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.887645 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.887668 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:24:16.887755 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.887761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.887980 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.888133 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:16.888381 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.889472 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.890902 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.891724 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.891848 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.891976 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.892078 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.892165 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1057,"thread_start_us":117,"threads_started":1}
I20260812 11:24:16.892477 12099 raft_consensus.cc:348] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.892585 12099 raft_consensus.cc:374] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:16.892620 12099 raft_consensus.cc:729] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b01be9ac27a4c0fbb94d8eb104315c1, State: Initialized, Role: FOLLOWER
I20260812 11:24:16.892727 12099 consensus_queue.cc:260] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.892970 12099 ts_tablet_manager.cc:1428] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:24:16.894011 12694 tablet_service.cc:1467] Processing CreateTablet for tablet 23780b4cd8474a758f6c0e06abe541e3 (DEFAULT_TABLE table=test-table [id=5f6694e1ba334bb397671f1e4fa427c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:16.894932 12694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23780b4cd8474a758f6c0e06abe541e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:16.896860 12426 tablet_service.cc:1467] Processing CreateTablet for tablet 23780b4cd8474a758f6c0e06abe541e3 (DEFAULT_TABLE table=test-table [id=5f6694e1ba334bb397671f1e4fa427c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:16.897710 12426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23780b4cd8474a758f6c0e06abe541e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:16.901289 12831 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Bootstrap starting.
I20260812 11:24:16.903558 12835 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Bootstrap starting.
I20260812 11:24:16.903821 12831 tablet_bootstrap.cc:654] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:16.904568 12831 log.cc:824] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:16.905555 12835 tablet_bootstrap.cc:654] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:16.906201 12831 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: No bootstrap required, opened a new log
I20260812 11:24:16.906196 12835 log.cc:824] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:16.906369 12831 ts_tablet_manager.cc:1397] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260812 11:24:16.908079 12835 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: No bootstrap required, opened a new log
I20260812 11:24:16.908254 12835 ts_tablet_manager.cc:1397] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:24:16.909562 12831 raft_consensus.cc:348] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.909775 12831 raft_consensus.cc:374] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:16.909832 12831 raft_consensus.cc:729] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c69dde634f94401a6ae2770e74f8413, State: Initialized, Role: FOLLOWER
I20260812 11:24:16.910233 12831 consensus_queue.cc:260] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.910841 12803 heartbeater.cc:503] Master 127.12.175.254:43923 was elected leader, sending a full tablet report...
I20260812 11:24:16.911077 12831 ts_tablet_manager.cc:1428] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260812 11:24:16.911197 12835 raft_consensus.cc:348] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.911451 12835 raft_consensus.cc:374] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:16.911516 12835 raft_consensus.cc:729] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24327dd197374a44ba40c10983b804da, State: Initialized, Role: FOLLOWER
I20260812 11:24:16.911899 12835 consensus_queue.cc:260] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.912456 12561 heartbeater.cc:503] Master 127.12.175.254:43923 was elected leader, sending a full tablet report...
I20260812 11:24:16.912773 12835 ts_tablet_manager.cc:1428] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260812 11:24:16.922397 12562 tablet.cc:2369] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:16.973272 12841 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:16.973438 12841 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
W20260812 11:24:16.973793 12299 tablet.cc:2369] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:16.974483 12841 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469)
I20260812 11:24:16.977998 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.974767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:41225 (local address 127.12.175.195:43647)
0812 11:24:16.974884 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.974888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.974902 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:24:16.975197 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.975201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.975250 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.975338 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:16.975601 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.976109 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.977097 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.977488 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.977595 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.977646 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.977822 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.977892 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:24:16.977998 12563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.974699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:43647 (local address 127.12.175.194:41225)
0812 11:24:16.974827 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.974842 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.974929 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.975357 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.975360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.975380 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:16.975499 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.975505 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.976216 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.976220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.976973 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.976983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.977604 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.977608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.977713 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.977733 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.977797 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.977870 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"spinlock_wait_cycles":7040}
I20260812 11:24:16.978363 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.975085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:44899 (local address 127.12.175.193:37469)
0812 11:24:16.975205 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:16.975209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:16.975380 (+ 171us) server_negotiation.cc:407] Connection header received
0812 11:24:16.975531 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:16.975534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:16.975586 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:16.975662 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:16.975908 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.976424 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.977384 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.977815 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.977920 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.978053 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:16.978174 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 11:24:16.978253 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:24:16.978664 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:16.974956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37469 (local address 127.12.175.194:44899)
0812 11:24:16.975286 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:16.975300 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:16.975415 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:16.975679 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:16.975682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:16.975696 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:16.975808 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.975813 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.976526 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.976529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.977272 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:16.977280 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:16.977924 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:16.977928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:16.978032 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:16.978054 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:24:16.978492 (+ 438us) client_negotiation.cc:240] Negotiation successful
0812 11:24:16.978567 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260812 11:24:16.978633 12723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23780b4cd8474a758f6c0e06abe541e3" candidate_uuid: "24327dd197374a44ba40c10983b804da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c69dde634f94401a6ae2770e74f8413" is_pre_election: true
I20260812 11:24:16.978899 12723 raft_consensus.cc:2454] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24327dd197374a44ba40c10983b804da in term 0.
I20260812 11:24:16.979188 12210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23780b4cd8474a758f6c0e06abe541e3" candidate_uuid: "24327dd197374a44ba40c10983b804da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" is_pre_election: true
I20260812 11:24:16.979385 12350 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da; no voters:
I20260812 11:24:16.979482 12210 raft_consensus.cc:2454] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24327dd197374a44ba40c10983b804da in term 0.
I20260812 11:24:16.979681 12841 raft_consensus.cc:2781] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:24:16.979763 12841 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:24:16.979810 12841 raft_consensus.cc:3037] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:16.980794 12841 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.981084 12841 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [CANDIDATE]: Term 1 election: Requested vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469)
I20260812 11:24:16.981390 12723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23780b4cd8474a758f6c0e06abe541e3" candidate_uuid: "24327dd197374a44ba40c10983b804da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c69dde634f94401a6ae2770e74f8413"
I20260812 11:24:16.981448 12210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23780b4cd8474a758f6c0e06abe541e3" candidate_uuid: "24327dd197374a44ba40c10983b804da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1"
I20260812 11:24:16.981508 12723 raft_consensus.cc:3037] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:16.981603 12210 raft_consensus.cc:3037] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:16.982496 12723 raft_consensus.cc:2454] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24327dd197374a44ba40c10983b804da in term 1.
I20260812 11:24:16.982620 12210 raft_consensus.cc:2454] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24327dd197374a44ba40c10983b804da in term 1.
I20260812 11:24:16.982775 12350 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da; no voters:
I20260812 11:24:16.982942 12841 raft_consensus.cc:2781] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:16.983137 12841 raft_consensus.cc:686] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 1 LEADER]: Becoming Leader. State: Replica: 24327dd197374a44ba40c10983b804da, State: Running, Role: LEADER
I20260812 11:24:16.983443 12841 consensus_queue.cc:237] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:16.986111 11950 catalog_manager.cc:5495] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da reported cstate change: term changed from 0 to 1, leader changed from <none> to 24327dd197374a44ba40c10983b804da (127.12.175.194). New cstate: current_term: 1 leader_uuid: "24327dd197374a44ba40c10983b804da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } health_report { overall_health: UNKNOWN } } }
I20260812 11:24:17.010864 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:17.007613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.12.175.194:39783)
0812 11:24:17.007729 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:17.007733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:17.007746 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:24:17.007908 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:17.007910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:17.007967 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:17.008066 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:24:17.008293 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:17.008764 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:17.009596 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:17.009805 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:17.009891 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:17.010168 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:24:17.010514 (+ 346us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:24:17.010618 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:17.010698 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 11:24:17.010750 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:24:17.016420 12723 raft_consensus.cc:1261] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Refusing update from remote peer 24327dd197374a44ba40c10983b804da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:17.016417 12210 raft_consensus.cc:1261] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Refusing update from remote peer 24327dd197374a44ba40c10983b804da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:17.017072 12845 consensus_queue.cc:1035] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:17.017249 12841 consensus_queue.cc:1035] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:17.022653 12850 mvcc.cc:205] Tried to move back new op lower bound from 7317642678332411904 to 7317642678206320640. Current Snapshot: MvccSnapshot[applied={T|T < 7317642678332411904}]
I20260812 11:24:17.023329 12851 mvcc.cc:205] Tried to move back new op lower bound from 7317642678332411904 to 7317642678206320640. Current Snapshot: MvccSnapshot[applied={T|T < 7317642678332411904}]
I20260812 11:24:17.031462 11951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:17.031620 11951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:17.033792 11951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Sending DeleteTablet for 3 replicas of tablet 23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:17.034474 12426 tablet_service.cc:1514] Processing DeleteTablet for tablet 23780b4cd8474a758f6c0e06abe541e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:17 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:42058
I20260812 11:24:17.034646 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 12016
I20260812 11:24:17.034607 12694 tablet_service.cc:1514] Processing DeleteTablet for tablet 23780b4cd8474a758f6c0e06abe541e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:17 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:45672
I20260812 11:24:17.050365 12864 tablet_replica.cc:330] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: stopping tablet replica
I20260812 11:24:17.050824 12864 raft_consensus.cc:2229] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:24:17.051380 12864 raft_consensus.cc:2258] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:17.056989 12864 ts_tablet_manager.cc:1905] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:17.060499 12864 ts_tablet_manager.cc:1918] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:17.060695 12864 log.cc:1196] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:17.061233 12864 ts_tablet_manager.cc:1939] T 23780b4cd8474a758f6c0e06abe541e3 P 24327dd197374a44ba40c10983b804da: Deleting consensus metadata
I20260812 11:24:17.062796 11928 catalog_manager.cc:4841] TS 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): tablet 23780b4cd8474a758f6c0e06abe541e3 (table test-table [id=5f6694e1ba334bb397671f1e4fa427c8]) successfully deleted
I20260812 11:24:17.077797 12866 tablet_replica.cc:330] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: stopping tablet replica
I20260812 11:24:17.078205 12866 raft_consensus.cc:2229] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:17.078557 12866 raft_consensus.cc:2258] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:17.080173 12866 ts_tablet_manager.cc:1905] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:17.082811 12866 ts_tablet_manager.cc:1918] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:17.082906 12866 log.cc:1196] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:17.083204 12866 ts_tablet_manager.cc:1939] T 23780b4cd8474a758f6c0e06abe541e3 P 1c69dde634f94401a6ae2770e74f8413: Deleting consensus metadata
I20260812 11:24:17.084417 11929 catalog_manager.cc:4841] TS 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): tablet 23780b4cd8474a758f6c0e06abe541e3 (table test-table [id=5f6694e1ba334bb397671f1e4fa427c8]) successfully deleted
W20260812 11:24:17.085103 11929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:37469 (error 108)
I20260812 11:24:17.085368 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 12305
I20260812 11:24:17.091423 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:17.091099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37469 (local address 127.0.0.1:35336)
0812 11:24:17.091278 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:17.091341 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260812 11:24:17.091557 11929 catalog_manager.cc:4584] TS 9b01be9ac27a4c0fbb94d8eb104315c1 (127.12.175.193:37469): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 23780b4cd8474a758f6c0e06abe541e3: Network error: Client connection negotiation failed: client connection to 127.12.175.193:37469: connect: Connection refused (error 111)
I20260812 11:24:17.107870 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 12564
I20260812 11:24:17.119041 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 11894
I20260812 11:24:37.130484 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43923
--webserver_interface=127.12.175.254
--webserver_port=40283
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:43923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:37.244042 12870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:37.244262 12870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:37.244318 12870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:37.248287 12870 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:24:37.248332 12870 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:24:37.248353 12870 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:24:37.248369 12870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:24:37.248394 12870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:37.248425 12870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:37.248449 12870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:24:37.248477 12870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:24:37.253445 12870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:43923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=40283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:37.254365 12870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:37.255306 12870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:37.263422 12883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:37.263445 12882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:37.263533 12870 server_base.cc:1034] running on GCE node
W20260812 11:24:37.263447 12886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:37.264178 12870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:37.265141 12870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:37.266287 12870 hybrid_clock.cc:648] HybridClock initialized: now 1786533877266268 us; error 33 us; skew 500 ppm
Aug 12 11:24:37 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533877, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:37.274422 12870 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:24:37.275246 12870 webserver.cc:460] Webserver started at http://127.12.175.254:40283/ using document root <none> and password file <none>
I20260812 11:24:37.275777 12870 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:37.275846 12870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:37.279438 12870 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 11:24:37.281466 12896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.282611 12870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:37.282724 12870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "1ddb93046eb445529026a232cb9a0296"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "e76e7e6721ff8d33e12807fc44b8def1"
server_key_iv: "19d0f3af759fca04eda61b3bf1157ba3"
server_key_version: "encryptionkey@0"
I20260812 11:24:37.283214 12870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:37.294361 12870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:37.296862 12870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:37.297015 12870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:37.303402 12870 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:43923
I20260812 11:24:37.303673 12983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:43923 every 8 connection(s)
I20260812 11:24:37.304414 12870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:24:37.307893 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 12870
I20260812 11:24:37.308305 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:37469
--local_ip_for_outbound_sockets=127.12.175.193
--tserver_master_addrs=127.12.175.254:43923
--webserver_port=35549
--webserver_interface=127.12.175.193
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:24:37.308429 12984 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:24:37.309949 12984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap starting.
I20260812 11:24:37.326622 12984 log.cc:824] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:37.337116 12984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:24:37.337409 12984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Bootstrap complete.
I20260812 11:24:37.341104 12984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:37.341459 12984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ddb93046eb445529026a232cb9a0296, State: Initialized, Role: FOLLOWER
I20260812 11:24:37.341914 12984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:37.342036 12984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:24:37.342103 12984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:24:37.342195 12984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:24:37.343952 12984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:37.344251 12984 leader_election.cc:302] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ddb93046eb445529026a232cb9a0296; no voters:
I20260812 11:24:37.344529 12984 leader_election.cc:288] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:24:37.344648 13008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:24:37.344957 13008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [term 3 LEADER]: Becoming Leader. State: Replica: 1ddb93046eb445529026a232cb9a0296, State: Running, Role: LEADER
I20260812 11:24:37.345265 13008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } }
I20260812 11:24:37.345805 12984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:24:37.346280 13008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ddb93046eb445529026a232cb9a0296. Latest consensus state: current_term: 3 leader_uuid: "1ddb93046eb445529026a232cb9a0296" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } } }
I20260812 11:24:37.346395 13008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:37.346798 13015 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:24:37.346761 13009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1ddb93046eb445529026a232cb9a0296" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ddb93046eb445529026a232cb9a0296" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43923 } } }
I20260812 11:24:37.346969 13009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296 [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:37.351716 13015 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:24:37.352344 13015 catalog_manager.cc:1259] Loaded cluster ID: ef73ac83e5834d83a52b6bee8119dafc
I20260812 11:24:37.352402 13015 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:24:37.354820 13015 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:24:37.355585 13015 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Loaded TSK: 0
I20260812 11:24:37.355665 13015 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1ddb93046eb445529026a232cb9a0296: Loaded TSK: 1
F20260812 11:24:37.356367 13015 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fdc8467f9ad google::LogMessage::Fail() at ??:0
@ 0x7fdc8468288a google::LogMessage::SendToLog() at ??:0
@ 0x7fdc8467f4de google::LogMessage::Flush() at ??:0
@ 0x7fdc84680a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fdc8734318d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fdc8733bf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fdc8efe47bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fdc8efbe99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fdc8efbf178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fdc8f000df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fdc8f01f82b std::function<>::operator()() at ??:0
@ 0x7fdc8efbeb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fdc8efbff3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fdc8efbc579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fdc8f000640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fdc868d13d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fdc868d1c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fdc868d33f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fdc868c2512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fdc87f066db start_thread at ??:0
@ 0x7fdc8317d61f clone at ??:0
W20260812 11:24:37.437567 12990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:37.437772 12990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:37.437808 12990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:37.442134 12990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:37.442188 12990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:37.442261 12990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:24:37.447775 12990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:37469
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=35549
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:37.448621 12990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:37.449538 12990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:37.458585 13092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:37.458593 13102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:37.458595 13089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:37.459033 12990 server_base.cc:1034] running on GCE node
I20260812 11:24:37.459547 12990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:37.460237 12990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:37.461432 12990 hybrid_clock.cc:648] HybridClock initialized: now 1786533877461407 us; error 31 us; skew 500 ppm
Aug 12 11:24:37 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533877, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:37.464648 12990 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:24:37.465654 12990 webserver.cc:460] Webserver started at http://127.12.175.193:35549/ using document root <none> and password file <none>
I20260812 11:24:37.466310 12990 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:37.466401 12990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:37.471481 12990 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:24:37.474184 13114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.475786 12990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:24:37.475979 12990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "9b01be9ac27a4c0fbb94d8eb104315c1"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "db187ad8a21f1482b6fb2b1bb0897df2"
server_key_iv: "8a2da49ec066d443f44d86eedccf1a13"
server_key_version: "encryptionkey@0"
I20260812 11:24:37.476679 12990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:37.501469 12990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:37.505357 12990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:37.505597 12990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:37.508590 12990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:37.509848 13132 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:24:37.515163 12990 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:24:37.515237 12990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260812 11:24:37.515327 12990 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:24:37.517405 12990 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:24:37.517464 12990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 11:24:37.517870 13132 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap starting.
I20260812 11:24:37.527982 12990 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:37469
I20260812 11:24:37.528030 13338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:37469 every 8 connection(s)
I20260812 11:24:37.529058 12990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:24:37.535516 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 12990
I20260812 11:24:37.535996 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:39783
--local_ip_for_outbound_sockets=127.12.175.194
--tserver_master_addrs=127.12.175.254:43923
--webserver_port=35105
--webserver_interface=127.12.175.194
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:24:37.540706 13132 log.cc:824] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:37.547847 13132 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:24:37.548151 13132 tablet_bootstrap.cc:492] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Bootstrap complete.
I20260812 11:24:37.549072 13132 ts_tablet_manager.cc:1397] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent bootstrapping tablet: real 0.031s user 0.020s sys 0.008s
I20260812 11:24:37.551255 13132 raft_consensus.cc:348] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:37.551743 13132 raft_consensus.cc:729] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b01be9ac27a4c0fbb94d8eb104315c1, State: Initialized, Role: FOLLOWER
I20260812 11:24:37.552186 13132 consensus_queue.cc:260] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:37.553005 13132 ts_tablet_manager.cc:1428] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260812 11:24:37.606901 13345 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:24:37.531186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:58937)
0812 11:24:37.531772 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.531827 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:37.532824 (+ 997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:37.606192 (+ 73368us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":159,"threads_started":1}
W20260812 11:24:37.607466 13342 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:43923 (0 consecutive failures): Network error: Failed to ping master at 127.12.175.254:43923: Client connection negotiation failed: client connection to 127.12.175.254:43923: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:24:37.608160 13345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.607910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:52323)
0812 11:24:37.608041 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.608104 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 11:24:37.608740 13345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.608551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:45989)
0812 11:24:37.608646 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.608691 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:24:37.608881 13342 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:24:37.659322 13346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:37.659533 13346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:37.659597 13346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:37.663457 13346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:37.663506 13346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:37.663587 13346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:24:37.668512 13346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:39783
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=35105
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:37.669378 13346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:37.670269 13346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:37.679037 13360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:37.679018 13364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:37.679009 13361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:37.679279 13346 server_base.cc:1034] running on GCE node
I20260812 11:24:37.679714 13346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:37.680263 13346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:37.681420 13346 hybrid_clock.cc:648] HybridClock initialized: now 1786533877681406 us; error 27 us; skew 500 ppm
Aug 12 11:24:37 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533877, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:37.683871 13346 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:24:37.684655 13346 webserver.cc:460] Webserver started at http://127.12.175.194:35105/ using document root <none> and password file <none>
I20260812 11:24:37.685148 13346 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:37.685211 13346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:37.688706 13346 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 11:24:37.690542 13383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.691665 13346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 11:24:37.691767 13346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "24327dd197374a44ba40c10983b804da"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "83921a6fc122fa96ac538283b5cb6b91"
server_key_iv: "0108cfe0c0efa2f37c1d2a87f2e3a9eb"
server_key_version: "encryptionkey@0"
I20260812 11:24:37.692238 13346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:37.712518 13346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:37.714833 13346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:37.714983 13346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:37.715521 13346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:37.716256 13346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:37.716302 13346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.716355 13346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:37.716389 13346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.724659 13346 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:39783
I20260812 11:24:37.724689 13593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:39783 every 8 connection(s)
I20260812 11:24:37.725520 13346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:24:37.728925 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.727353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:50411)
0812 11:24:37.727770 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.727865 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":108,"threads_started":1}
W20260812 11:24:37.729349 13594 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:43923 (0 consecutive failures): Network error: Failed to ping master at 127.12.175.254:43923: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
I20260812 11:24:37.729883 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.729696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:32817)
0812 11:24:37.729787 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.729830 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 11:24:37.730378 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.730214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:37339)
0812 11:24:37.730296 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.730334 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 11:24:37.730518 13594 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:24:37.733623 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13346
I20260812 11:24:37.734033 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:43647
--local_ip_for_outbound_sockets=127.12.175.195
--tserver_master_addrs=127.12.175.254:43923
--webserver_port=42011
--webserver_interface=127.12.175.195
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:37.839747 13599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:37.839968 13599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:37.840013 13599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:37.843907 13599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:37.843950 13599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:37.844017 13599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:24:37.849058 13599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:43647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=42011
--tserver_master_addrs=127.12.175.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:37.849920 13599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:37.850821 13599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:37.859581 13615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:37.859728 13599 server_base.cc:1034] running on GCE node
W20260812 11:24:37.859650 13618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:37.859649 13613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:37.860226 13599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:37.860735 13599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:37.861893 13599 hybrid_clock.cc:648] HybridClock initialized: now 1786533877861870 us; error 25 us; skew 500 ppm
Aug 12 11:24:37 dist-test-slave-gjrz krb5kdc[10843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533877, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:37.864372 13599 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:24:37.865109 13599 webserver.cc:460] Webserver started at http://127.12.175.195:42011/ using document root <none> and password file <none>
I20260812 11:24:37.865592 13599 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:37.865649 13599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:37.869086 13599 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:37.870946 13629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.872181 13599 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:37.872278 13599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "1c69dde634f94401a6ae2770e74f8413"
format_stamp: "Formatted at 2026-08-12 11:23:55 on dist-test-slave-gjrz"
server_key: "060969c42d77a8cf7ccc6b3ec494fd9a"
server_key_iv: "ca620d3d26ee3881de1168487f6e0f30"
server_key_version: "encryptionkey@0"
I20260812 11:24:37.872748 13599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:37.901651 13599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:37.904179 13599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:37.904338 13599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:37.904904 13599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:37.905669 13599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:37.905714 13599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.905756 13599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:37.905786 13599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:37.913829 13599 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:43647
I20260812 11:24:37.913882 13832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:43647 every 8 connection(s)
I20260812 11:24:37.914744 13599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:24:37.918228 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.916630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:40799)
0812 11:24:37.917052 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.917150 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":116,"threads_started":1}
W20260812 11:24:37.918649 13835 heartbeater.cc:644] Failed to heartbeat to 127.12.175.254:43923 (0 consecutive failures): Network error: Failed to ping master at 127.12.175.254:43923: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
I20260812 11:24:37.919188 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.918988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:55449)
0812 11:24:37.919088 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.919134 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 11:24:37.919713 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:37.919558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:47391)
0812 11:24:37.919633 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:37.919670 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 11:24:37.919862 13835 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:24:37.920437 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13599
I20260812 11:24:38.609778 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:38.609372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:40477)
0812 11:24:38.609626 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:38.609679 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
I20260812 11:24:38.731452 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:38.731049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:53553)
0812 11:24:38.731298 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:38.731353 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":72,"threads_started":1}
I20260812 11:24:38.920665 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:38.920292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:56203)
0812 11:24:38.920516 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:38.920570 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":81,"threads_started":1}
I20260812 11:24:39.255153 13846 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:39.255391 13846 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:39.256465 13846 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
Aug 12 11:24:39 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533877, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.195@KRBTEST.COM
Aug 12 11:24:39 dist-test-slave-gjrz krb5kdc[10843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533877, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.194@KRBTEST.COM
I20260812 11:24:39.270385 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.256620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:43647 (local address 127.12.175.193:37963)
0812 11:24:39.256925 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:39.256940 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:39.257066 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:39.258711 (+ 1645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:39.258717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:39.259259 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:39.259801 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:39.259815 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.261073 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.261077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:39.262020 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:39.262030 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.262681 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.262685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:39.262933 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:39.263612 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:39.263625 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:39.265140 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:39.267440 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:39.267445 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:39.267456 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:39.267873 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:39.268257 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:39.268260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:39.268262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:39.268465 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:39.269211 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:39.269217 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:39.269573 (+ 356us) client_negotiation.cc:769] Sending connection context
0812 11:24:39.269799 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 11:24:39.270160 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":224,"spinlock_wait_cycles":25984,"thread_start_us":60,"threads_started":1}
I20260812 11:24:39.270448 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.256802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:37963 (local address 127.12.175.195:43647)
0812 11:24:39.257312 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:39.257331 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:39.257365 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:24:39.257996 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:39.258002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:39.258351 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:39.258633 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:39.259959 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.260942 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.262131 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.262572 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.262715 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:39.265346 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:39.265351 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:39.265362 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:39.265389 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:39.267328 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:39.267986 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:39.267992 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:39.267998 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:39.268158 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:39.268560 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:39.268562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:39.268564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:39.269081 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:39.269212 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:39.269976 (+ 764us) server_negotiation.cc:299] Negotiation successful
0812 11:24:39.270259 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":131,"threads_started":1}
I20260812 11:24:39.270455 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.256894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:54901 (local address 127.12.175.194:39783)
0812 11:24:39.257280 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:39.257292 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:39.257327 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:24:39.258055 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:39.258060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:39.258350 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:39.258633 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:39.259955 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.260948 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.262135 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.262570 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.262715 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:39.265686 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:39.265692 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:39.265707 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:39.265738 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:39.267434 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:39.267986 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:39.267992 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:39.267998 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:39.268158 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:39.268562 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:39.268565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:39.268566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:39.269077 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:39.269212 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:39.269971 (+ 759us) server_negotiation.cc:299] Negotiation successful
0812 11:24:39.270259 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":84,"threads_started":1}
I20260812 11:24:39.270383 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.256689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:39783 (local address 127.12.175.193:54901)
0812 11:24:39.257014 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:39.257038 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:39.257137 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:39.258711 (+ 1574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:39.258717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:39.259274 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:39.259799 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:39.259814 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.261077 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.261080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:39.262021 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:39.262031 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:39.262681 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:39.262685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:39.262935 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:39.263564 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:39.263580 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:39.265465 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:39.267547 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:39.267551 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:39.267553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:39.267873 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:39.268257 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:39.268260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:39.268262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:39.268470 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:39.269211 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:39.269217 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:39.269573 (+ 356us) client_negotiation.cc:769] Sending connection context
0812 11:24:39.269799 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 11:24:39.270219 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":388,"spinlock_wait_cycles":35456,"thread_start_us":68,"threads_started":1}
W20260812 11:24:39.272822 13128 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
W20260812 11:24:39.272979 13121 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:39.273048 13121 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b01be9ac27a4c0fbb94d8eb104315c1; no voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da
I20260812 11:24:39.273263 13846 raft_consensus.cc:2726] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:24:39.610687 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.610432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:42469)
0812 11:24:39.610542 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:39.610601 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 11:24:39.732483 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.732096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:47563)
0812 11:24:39.732320 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:39.732371 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":74,"threads_started":1}
I20260812 11:24:39.921641 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:39.921284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:41595)
0812 11:24:39.921507 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:39.921560 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":81,"threads_started":1}
I20260812 11:24:40.611732 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:40.611333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:39547)
0812 11:24:40.611578 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:40.611633 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":74,"threads_started":1}
I20260812 11:24:40.733498 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:40.733115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:37875)
0812 11:24:40.733354 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:40.733408 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":73,"threads_started":1}
I20260812 11:24:40.922640 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:40.922236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:40041)
0812 11:24:40.922485 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:40.922548 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":66,"threads_started":1}
I20260812 11:24:40.979604 13860 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:40.979722 13860 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:40.980104 13860 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
W20260812 11:24:40.980886 13128 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
W20260812 11:24:40.981026 13121 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:40.981096 13121 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b01be9ac27a4c0fbb94d8eb104315c1; no voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da
I20260812 11:24:40.981237 13860 raft_consensus.cc:2726] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:24:41.612756 13862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:41.612345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:34583)
0812 11:24:41.612594 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:41.612651 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":70,"threads_started":1}
I20260812 11:24:41.734489 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:41.734091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:41143)
0812 11:24:41.734323 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:41.734373 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260812 11:24:41.923604 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:41.923217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:38337)
0812 11:24:41.923471 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:41.923523 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":89,"threads_started":1}
I20260812 11:24:42.613953 13866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:42.613539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:33273)
0812 11:24:42.613809 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:42.613859 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":68,"threads_started":1}
I20260812 11:24:42.735563 13874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:42.735141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:58049)
0812 11:24:42.735402 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:42.735463 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":73,"threads_started":1}
I20260812 11:24:42.924592 13875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:42.924250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:44231)
0812 11:24:42.924458 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:42.924507 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":69,"threads_started":1}
I20260812 11:24:43.317190 13876 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:43.317325 13876 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:43.317827 13876 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
W20260812 11:24:43.318573 13121 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
W20260812 11:24:43.318676 13128 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:43.318733 13128 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b01be9ac27a4c0fbb94d8eb104315c1; no voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da
I20260812 11:24:43.318862 13876 raft_consensus.cc:2726] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:24:43.614933 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:43.614551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:54851)
0812 11:24:43.614786 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:43.614838 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":78,"threads_started":1}
I20260812 11:24:43.736514 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:43.736155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:34163)
0812 11:24:43.736376 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:43.736424 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":82,"threads_started":1}
I20260812 11:24:43.925554 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:43.925192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:55215)
0812 11:24:43.925409 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:43.925458 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":69,"threads_started":1}
I20260812 11:24:44.615980 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:44.615603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:51535)
0812 11:24:44.615834 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:44.615886 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":73,"threads_started":1}
I20260812 11:24:44.737542 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:44.737123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:46101)
0812 11:24:44.737396 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:44.737448 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":68,"threads_started":1}
I20260812 11:24:44.926647 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:44.926213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:38597)
0812 11:24:44.926502 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:44.926558 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":86,"threads_started":1}
I20260812 11:24:45.617125 13884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:45.616681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:48395)
0812 11:24:45.616950 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:45.617014 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":90,"threads_started":1}
I20260812 11:24:45.624830 13888 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:45.624940 13888 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:45.625272 13888 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
W20260812 11:24:45.625942 13128 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
W20260812 11:24:45.626055 13121 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:45.626140 13121 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b01be9ac27a4c0fbb94d8eb104315c1; no voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da
I20260812 11:24:45.626271 13888 raft_consensus.cc:2726] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:24:45.738670 13890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:45.738261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:35807)
0812 11:24:45.738516 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:45.738578 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":95,"threads_started":1}
I20260812 11:24:45.927778 13892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:45.927382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:49391)
0812 11:24:45.927611 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:45.927671 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":74,"threads_started":1}
I20260812 11:24:46.618212 13893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:46.617837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:51543)
0812 11:24:46.618069 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:46.618120 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":69,"threads_started":1}
I20260812 11:24:46.739759 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:46.739374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:46485)
0812 11:24:46.739618 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:46.739670 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":77,"threads_started":1}
I20260812 11:24:46.928745 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:46.928394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:37289)
0812 11:24:46.928608 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:46.928658 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":72,"threads_started":1}
I20260812 11:24:47.619349 13898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:47.618929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:45879)
0812 11:24:47.619174 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:47.619224 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":73,"threads_started":1}
I20260812 11:24:47.740722 13899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:47.740359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:41301)
0812 11:24:47.740579 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:47.740628 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":70,"threads_started":1}
I20260812 11:24:47.929708 13900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:47.929370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:33981)
0812 11:24:47.929574 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:47.929623 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":66,"threads_started":1}
I20260812 11:24:48.620347 13902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:48.619947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:60015)
0812 11:24:48.620191 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:48.620251 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260812 11:24:48.741773 13903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:48.741367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:46821)
0812 11:24:48.741585 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:48.741656 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":70,"threads_started":1}
I20260812 11:24:48.930742 13904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:48.930343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:32769)
0812 11:24:48.930603 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:48.930655 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260812 11:24:49.621466 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:49.621040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:54233)
0812 11:24:49.621309 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:49.621365 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":85,"threads_started":1}
I20260812 11:24:49.742831 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:49.742395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:42751)
0812 11:24:49.742682 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:49.742738 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":97,"threads_started":1}
I20260812 11:24:49.867094 13909 raft_consensus.cc:482] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:49.867215 13909 raft_consensus.cc:504] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c69dde634f94401a6ae2770e74f8413" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 43647 } } peers { permanent_uuid: "24327dd197374a44ba40c10983b804da" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 39783 } } peers { permanent_uuid: "9b01be9ac27a4c0fbb94d8eb104315c1" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37469 } }
I20260812 11:24:49.867614 13909 leader_election.cc:288] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647), 24327dd197374a44ba40c10983b804da (127.12.175.194:39783)
W20260812 11:24:49.868331 13121 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24327dd197374a44ba40c10983b804da (127.12.175.194:39783): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
W20260812 11:24:49.868449 13128 leader_election.cc:341] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1c69dde634f94401a6ae2770e74f8413 (127.12.175.195:43647): Not found: Tablet not found: 23780b4cd8474a758f6c0e06abe541e3
I20260812 11:24:49.868544 13128 leader_election.cc:302] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b01be9ac27a4c0fbb94d8eb104315c1; no voters: 1c69dde634f94401a6ae2770e74f8413, 24327dd197374a44ba40c10983b804da
I20260812 11:24:49.868681 13909 raft_consensus.cc:2726] T 23780b4cd8474a758f6c0e06abe541e3 P 9b01be9ac27a4c0fbb94d8eb104315c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:24:49.931756 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:49.931355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:41615)
0812 11:24:49.931598 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:49.931652 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":83,"threads_started":1}
I20260812 11:24:50.622501 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:50.622142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:32951)
0812 11:24:50.622356 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:50.622406 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":71,"threads_started":1}
I20260812 11:24:50.743892 13913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:50.743517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:48047)
0812 11:24:50.743748 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:50.743800 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":72,"threads_started":1}
I20260812 11:24:50.932763 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:50.932400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:38507)
0812 11:24:50.932628 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:50.932677 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":69,"threads_started":1}
I20260812 11:24:51.623586 13915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:51.623186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:43141)
0812 11:24:51.623435 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:51.623490 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":93,"threads_started":1}
I20260812 11:24:51.744911 13916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:51.744539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:38297)
0812 11:24:51.744767 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:51.744817 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":76,"threads_started":1}
I20260812 11:24:51.933702 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:51.933351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:39725)
0812 11:24:51.933564 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:51.933611 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":76,"threads_started":1}
I20260812 11:24:52.624737 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:52.624372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.193:46031)
0812 11:24:52.624596 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:52.624645 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":77,"threads_started":1}
I20260812 11:24:52.746045 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:52.745678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.194:56879)
0812 11:24:52.745902 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:52.745952 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":70,"threads_started":1}
I20260812 11:24:52.922746 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 12990
I20260812 11:24:52.934916 13921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:52.934523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:43923 (local address 127.12.175.195:51137)
0812 11:24:52.934767 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:52.934821 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.254:43923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
I20260812 11:24:52.937819 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13346
I20260812 11:24:52.949860 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13599
2026-08-12T11:24:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59183 ms)
[----------] 30 tests from SecurityITest (238397 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:24:53 dist-test-slave-gjrz krb5kdc[13931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:24:53 dist-test-slave-gjrz krb5kdc[13931](info): set up 2 sockets
Aug 12 11:24:53 dist-test-slave-gjrz krb5kdc[13931](info): commencing operation
krb5kdc: starting...
W20260812 11:24:54.170202 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:24:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:24:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:24:54.283149 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:35665
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:35665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:54.387967 13950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:54.388183 13950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:54.388235 13950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:54.392124 13950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:24:54.392171 13950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:54.392196 13950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:54.392217 13950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:24:54.392241 13950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:24:54.397113 13950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:35665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:35665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:54.397943 13950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:54.398801 13950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:54.406523 13957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:54.406570 13960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:54.406539 13955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:54.406780 13950 server_base.cc:1034] running on GCE node
I20260812 11:24:54.407335 13950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:54.408298 13950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:54.409456 13950 hybrid_clock.cc:648] HybridClock initialized: now 1786533894409437 us; error 32 us; skew 500 ppm
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:54.411978 13950 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:24:54.412740 13950 webserver.cc:460] Webserver started at http://127.12.175.254:42335/ using document root <none> and password file <none>
I20260812 11:24:54.413204 13950 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:54.413257 13950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:54.413406 13950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:54.415138 13950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "6692504ccbda4f85b92dbe669899e40e"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "0fbbe38a9dde3b7f6211fe525f9db3eb"
server_key_iv: "ce3e1461af23241e421c069482760f3d"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.415652 13950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "6692504ccbda4f85b92dbe669899e40e"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "0fbbe38a9dde3b7f6211fe525f9db3eb"
server_key_iv: "ce3e1461af23241e421c069482760f3d"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.418867 13950 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:24:54.421008 13972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.422137 13950 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:54.422240 13950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "6692504ccbda4f85b92dbe669899e40e"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "0fbbe38a9dde3b7f6211fe525f9db3eb"
server_key_iv: "ce3e1461af23241e421c069482760f3d"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.422319 13950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:54.441252 13950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:54.443701 13950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:54.443840 13950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:54.450307 13950 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:35665
I20260812 11:24:54.450321 14062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:35665 every 8 connection(s)
I20260812 11:24:54.451151 13950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:24:54.453712 14063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:54.458176 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 13950
I20260812 11:24:54.458287 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:24:54.458578 12991 external_mini_cluster.cc:1428] Setting key 2591c9a0b7f41155483bd47875b799c1
I20260812 11:24:54.458850 14063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e: Bootstrap starting.
I20260812 11:24:54.461374 14063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:54.462239 14063 log.cc:824] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:54.464277 14063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e: No bootstrap required, opened a new log
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:54.468067 14063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6692504ccbda4f85b92dbe669899e40e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35665 } }
I20260812 11:24:54.468297 14063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:54.468405 14063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6692504ccbda4f85b92dbe669899e40e, State: Initialized, Role: FOLLOWER
I20260812 11:24:54.468832 14063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6692504ccbda4f85b92dbe669899e40e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35665 } }
I20260812 11:24:54.468953 14063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:24:54.469012 14063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:24:54.469107 14063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:54.469923 14063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6692504ccbda4f85b92dbe669899e40e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35665 } }
I20260812 11:24:54.470250 14063 leader_election.cc:302] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6692504ccbda4f85b92dbe669899e40e; no voters:
I20260812 11:24:54.470582 14063 leader_election.cc:288] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:24:54.470659 14075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:54.470865 14075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [term 1 LEADER]: Becoming Leader. State: Replica: 6692504ccbda4f85b92dbe669899e40e, State: Running, Role: LEADER
I20260812 11:24:54.471220 14075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6692504ccbda4f85b92dbe669899e40e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35665 } }
I20260812 11:24:54.471777 14063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:24:54.472389 14075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6692504ccbda4f85b92dbe669899e40e. Latest consensus state: current_term: 1 leader_uuid: "6692504ccbda4f85b92dbe669899e40e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6692504ccbda4f85b92dbe669899e40e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35665 } } }
I20260812 11:24:54.472568 14075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:54.472757 14078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6692504ccbda4f85b92dbe669899e40e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6692504ccbda4f85b92dbe669899e40e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35665 } } }
I20260812 11:24:54.472870 14078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:54.472954 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:54.459899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37838 (local address 127.12.175.254:35665)
0812 11:24:54.460292 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:54.460310 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:54.460352 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:24:54.461117 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:54.461141 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:54.461535 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:54.461896 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:54.462532 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.463879 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.464750 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.465408 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.465575 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:54.467916 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:54.467921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:54.467934 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:54.467960 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:54.469628 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:54.470152 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:54.470157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:54.470161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:54.470269 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:54.470583 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:54.470586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:54.470588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:54.471086 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:54.471296 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:54.471586 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 11:24:54.471862 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260812 11:24:54.473080 14093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:24:54.476500 14093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:24:54.481197 14093 catalog_manager.cc:1347] Generated new cluster ID: 7672fe8465d944458b76a6913e6bc139
I20260812 11:24:54.481297 14093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:24:54.500694 14093 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:24:54.501801 14093 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:24:54.507668 14093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e: Generated new TSK 0
I20260812 11:24:54.508349 14093 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:24:54.534034 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:35665
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:54.640933 14114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:54.641145 14114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:54.641187 14114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:54.645033 14114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:54.645079 14114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:54.645147 14114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:24:54.650017 14114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:35665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:54.650872 14114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:54.651795 14114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:54.660336 14126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:54.660378 14132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:54.660375 14123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:54.660496 14114 server_base.cc:1034] running on GCE node
I20260812 11:24:54.660988 14114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:54.661541 14114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:54.662701 14114 hybrid_clock.cc:648] HybridClock initialized: now 1786533894662685 us; error 26 us; skew 500 ppm
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:54.665274 14114 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:24:54.666016 14114 webserver.cc:460] Webserver started at http://127.12.175.193:44147/ using document root <none> and password file <none>
I20260812 11:24:54.666496 14114 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:54.666560 14114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:54.666739 14114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:54.668582 14114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "1c1d5e80c30a4cb086a1710168926e00"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "4f26018652bd826c6a401b5ca3fbd17d"
server_key_iv: "8656c50d1a6241ffd371a2c7a99ded5a"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.669111 14114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "1c1d5e80c30a4cb086a1710168926e00"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "4f26018652bd826c6a401b5ca3fbd17d"
server_key_iv: "8656c50d1a6241ffd371a2c7a99ded5a"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.672649 14114 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:24:54.675130 14141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.676290 14114 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:54.676403 14114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "1c1d5e80c30a4cb086a1710168926e00"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "4f26018652bd826c6a401b5ca3fbd17d"
server_key_iv: "8656c50d1a6241ffd371a2c7a99ded5a"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.676499 14114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:54.692255 14114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:54.694654 14114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:54.694805 14114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:54.695343 14114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:54.696094 14114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:54.696138 14114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.696177 14114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:54.696206 14114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.704190 14114 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:33559
I20260812 11:24:54.704217 14358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:33559 every 8 connection(s)
I20260812 11:24:54.704972 14114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:24:54.709465 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14114
I20260812 11:24:54.709587 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:24:54.709964 12991 external_mini_cluster.cc:1428] Setting key 650c2bac7897a846406a317689d1fb57
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:54.718161 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:54.706474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:35223 (local address 127.12.175.254:35665)
0812 11:24:54.706585 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:54.706588 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:54.707304 (+ 716us) server_negotiation.cc:407] Connection header received
0812 11:24:54.708608 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:54.708611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:54.708671 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:54.708755 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:54.710042 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.710571 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.711987 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.712232 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.712314 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:54.714704 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:54.714708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:54.714710 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:54.714738 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:54.716167 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:54.716705 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:54.716708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:54.716710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:54.716803 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:54.717116 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:54.717119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:54.717121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:54.717345 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:54.717453 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:54.717861 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 11:24:54.717987 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:24:54.718765 14361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:54.706752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:35665 (local address 127.12.175.193:35223)
0812 11:24:54.707161 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:54.707201 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:54.708394 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:54.708918 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:54.708924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:54.709248 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:54.709870 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:54.709891 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.710706 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.710709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:54.711870 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:54.711882 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.712374 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.712386 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:54.712567 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:54.713062 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:54.713081 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:54.714555 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:54.716285 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:54.716290 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:54.716300 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:54.716608 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:54.716887 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:54.716890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:54.716892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:54.717024 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:54.717436 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:54.717440 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:54.717639 (+ 199us) client_negotiation.cc:769] Sending connection context
0812 11:24:54.717786 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:24:54.718009 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":109,"threads_started":1}
I20260812 11:24:54.719848 14359 heartbeater.cc:347] Connected to a master server at 127.12.175.254:35665
I20260812 11:24:54.720093 14359 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:24:54.720602 14359 heartbeater.cc:511] Master 127.12.175.254:35665 requested a full tablet report, sending...
I20260812 11:24:54.722020 14000 ts_manager.cc:194] Registered new tserver with Master: 1c1d5e80c30a4cb086a1710168926e00 (127.12.175.193:33559)
I20260812 11:24:54.723107 14000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:35223
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:24:54.735832 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:35665
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:54.841125 14369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:54.841336 14369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:54.841375 14369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:54.845254 14369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:54.845300 14369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:54.845369 14369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:24:54.850250 14369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:35665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:54.851100 14369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:54.852005 14369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:54.860392 14380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:54.860438 14377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:54.860442 14378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:54.860777 14369 server_base.cc:1034] running on GCE node
I20260812 11:24:54.861109 14369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:54.861666 14369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:54.862836 14369 hybrid_clock.cc:648] HybridClock initialized: now 1786533894862815 us; error 31 us; skew 500 ppm
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:54.865352 14369 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:24:54.866094 14369 webserver.cc:460] Webserver started at http://127.12.175.194:45253/ using document root <none> and password file <none>
I20260812 11:24:54.866578 14369 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:54.866639 14369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:54.866835 14369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:54.868769 14369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "92f985147a464696a2891baca8476463"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "cfa70380ba28fb5d1dbe617cb1cc81ab"
server_key_iv: "91d65e25b2021d4d4e9628021c3a5fe6"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.869315 14369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "92f985147a464696a2891baca8476463"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "cfa70380ba28fb5d1dbe617cb1cc81ab"
server_key_iv: "91d65e25b2021d4d4e9628021c3a5fe6"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.872886 14369 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 11:24:54.875099 14394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.876191 14369 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:54.876293 14369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "92f985147a464696a2891baca8476463"
format_stamp: "Formatted at 2026-08-12 11:24:54 on dist-test-slave-gjrz"
server_key: "cfa70380ba28fb5d1dbe617cb1cc81ab"
server_key_iv: "91d65e25b2021d4d4e9628021c3a5fe6"
server_key_version: "encryptionkey@0"
I20260812 11:24:54.876381 14369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:54.890074 14369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:54.892799 14369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:54.892952 14369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:54.893429 14369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:54.894198 14369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:54.894244 14369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.894291 14369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:54.894320 14369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:54.902117 14369 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:41217
I20260812 11:24:54.902171 14600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:41217 every 8 connection(s)
I20260812 11:24:54.902884 14369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:24:54.911088 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14369
Aug 12 11:24:54 dist-test-slave-gjrz krb5kdc[13931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533894, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:54.911207 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:24:54.911582 12991 external_mini_cluster.cc:1428] Setting key e58d29aa9002d17737944b569be6ab81
I20260812 11:24:54.914870 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:54.904400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:43181 (local address 127.12.175.254:35665)
0812 11:24:54.904524 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:54.904534 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:54.905227 (+ 693us) server_negotiation.cc:407] Connection header received
0812 11:24:54.906464 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:54.906467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:54.906534 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:54.906606 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:54.907680 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.908193 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.909263 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.909477 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.909572 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:54.911804 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:54.911807 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:54.911809 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:54.911832 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:54.913055 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:54.913585 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:54.913587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:54.913588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:54.913653 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:54.913967 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:54.913969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:54.913970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:54.914117 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:54.914184 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:54.914673 (+ 489us) server_negotiation.cc:299] Negotiation successful
0812 11:24:54.914756 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:24:54.915720 14608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:54.904696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:35665 (local address 127.12.175.194:43181)
0812 11:24:54.905093 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:54.905132 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:54.906267 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:54.906771 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:54.906778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:54.907094 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:54.907541 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:54.907554 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.908304 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.908307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:54.909147 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:54.909157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:54.909606 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:54.909610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:54.909763 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:54.910201 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:54.910215 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:54.911647 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:54.913163 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:54.913169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:54.913183 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:54.913502 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:54.913720 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:54.913723 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:54.913725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:54.913892 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:54.914198 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:54.914203 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:54.914465 (+ 262us) client_negotiation.cc:769] Sending connection context
0812 11:24:54.914651 (+ 186us) client_negotiation.cc:240] Negotiation successful
0812 11:24:54.914937 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":104,"threads_started":1}
I20260812 11:24:54.916746 14602 heartbeater.cc:347] Connected to a master server at 127.12.175.254:35665
I20260812 11:24:54.916966 14602 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:54.917441 14602 heartbeater.cc:511] Master 127.12.175.254:35665 requested a full tablet report, sending...
I20260812 11:24:54.918439 14000 ts_manager.cc:194] Registered new tserver with Master: 92f985147a464696a2891baca8476463 (127.12.175.194:41217)
I20260812 11:24:54.918967 14000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:43181
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:24:54.937867 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:35665
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:55.043140 14614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:55.043399 14614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:55.043462 14614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:55.047307 14614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:55.047353 14614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:55.047428 14614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:24:55.052518 14614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:35665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:55.053392 14614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:55.054275 14614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:55.062973 14629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:55.063074 14626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:55.063195 14614 server_base.cc:1034] running on GCE node
W20260812 11:24:55.063143 14638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:55.063670 14614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:55.064224 14614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:55.065376 14614 hybrid_clock.cc:648] HybridClock initialized: now 1786533895065362 us; error 31 us; skew 500 ppm
Aug 12 11:24:55 dist-test-slave-gjrz krb5kdc[13931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533895, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:55.067906 14614 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:24:55.068706 14614 webserver.cc:460] Webserver started at http://127.12.175.195:37551/ using document root <none> and password file <none>
I20260812 11:24:55.069191 14614 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:55.069253 14614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:55.069427 14614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:55.071254 14614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "87a286656eff475bbbfe0bf99f1fd190"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "aec5af3a2568807c8ef07e082d05b94b"
server_key_iv: "9102cdc288d79ad2d2290eaab2597088"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.071796 14614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "87a286656eff475bbbfe0bf99f1fd190"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "aec5af3a2568807c8ef07e082d05b94b"
server_key_iv: "9102cdc288d79ad2d2290eaab2597088"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.075337 14614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 11:24:55.077500 14650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.078588 14614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:55.078688 14614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "87a286656eff475bbbfe0bf99f1fd190"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "aec5af3a2568807c8ef07e082d05b94b"
server_key_iv: "9102cdc288d79ad2d2290eaab2597088"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.078771 14614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:55.089530 14614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:55.092227 14614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:55.092382 14614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:55.092906 14614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:55.093627 14614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:55.093674 14614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.093722 14614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:55.093750 14614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.101820 14614 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:36645
I20260812 11:24:55.101847 14864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:36645 every 8 connection(s)
I20260812 11:24:55.102571 14614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:24:55.102938 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14614
I20260812 11:24:55.103065 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:24:55.103407 12991 external_mini_cluster.cc:1428] Setting key 84ef85100f42aa56a4da5422072f9361
Aug 12 11:24:55 dist-test-slave-gjrz krb5kdc[13931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533895, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:55.114279 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.104192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:59743 (local address 127.12.175.254:35665)
0812 11:24:55.104303 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.104308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.105272 (+ 964us) server_negotiation.cc:407] Connection header received
0812 11:24:55.106570 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.106572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.106616 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.106673 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:55.107674 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.108185 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.109230 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.109443 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.109515 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.111594 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:55.111597 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:55.111599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:55.111622 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:55.112772 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:55.113190 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:55.113192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:55.113193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:55.113258 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:55.113491 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:55.113493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:55.113494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:55.113651 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:55.113719 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.114087 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.114169 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:24:55.114964 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.104634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:35665 (local address 127.12.175.195:59743)
0812 11:24:55.105120 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.105172 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.106372 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.106790 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.106796 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.107114 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:55.107569 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.107582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.108274 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.108277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.109127 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.109136 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.109548 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.109550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.109678 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.110076 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:55.110090 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:55.111432 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:55.112877 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:55.112882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:55.112892 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:55.113119 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:55.113315 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:55.113317 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:55.113318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:55.113429 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:55.113718 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:55.113722 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:55.113916 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.114057 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.114270 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":142,"threads_started":1}
I20260812 11:24:55.115983 14865 heartbeater.cc:347] Connected to a master server at 127.12.175.254:35665
I20260812 11:24:55.116201 14865 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:55.116709 14865 heartbeater.cc:511] Master 127.12.175.254:35665 requested a full tablet report, sending...
I20260812 11:24:55.117714 13998 ts_manager.cc:194] Registered new tserver with Master: 87a286656eff475bbbfe0bf99f1fd190 (127.12.175.195:36645)
I20260812 11:24:55.118275 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:59743
I20260812 11:24:55.129279 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:24:55.137334 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.131165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37840 (local address 127.12.175.254:35665)
0812 11:24:55.131284 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.131289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.131477 (+ 188us) server_negotiation.cc:407] Connection header received
0812 11:24:55.131581 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.131583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.131618 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.131681 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:55.132285 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.132783 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.133544 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.133756 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.133844 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.134931 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:55.134934 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:55.134935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:55.134957 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:55.136107 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:55.136459 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:55.136461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:55.136462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:55.136525 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:55.136698 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:55.136700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:55.136701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:55.136880 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:55.136976 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.137142 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.137229 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:24:55.139757 13998 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:24:55.142567 13998 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:24:55.155695 14886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.150249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:36645 (local address 127.0.0.1:60672)
0812 11:24:55.150731 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.150779 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.150910 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.151986 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.151993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.152014 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:55.152130 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.152138 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.153138 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.153140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.154210 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.154219 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.155173 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.155177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.155304 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.155346 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.155450 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.155557 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"spinlock_wait_cycles":3200,"thread_start_us":78,"threads_started":1}
I20260812 11:24:55.155735 14891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.151228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60672 (local address 127.12.175.195:36645)
0812 11:24:55.151622 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.151631 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.151648 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:24:55.151703 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.151707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.151846 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.151978 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:55.152261 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.153007 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.154325 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.155074 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.155194 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.155356 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.155501 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.155599 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":174,"threads_started":1}
I20260812 11:24:55.156504 14885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.150145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:33559 (local address 127.0.0.1:55184)
0812 11:24:55.150731 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.150780 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.150909 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.152084 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.152088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.152107 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:55.152216 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.152222 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.153799 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.153802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.154989 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.155000 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.156097 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.156101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.156199 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.156225 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.156303 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.156373 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":22,"spinlock_wait_cycles":6528,"thread_start_us":100,"threads_started":1}
I20260812 11:24:55.156545 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.150304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55184 (local address 127.12.175.193:33559)
0812 11:24:55.151192 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.151204 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.151227 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:24:55.151724 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.151729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.151911 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.152358 (+ 447us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:55.152503 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.153573 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.155134 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.155971 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.156099 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.156216 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.156327 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.156413 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":145,"threads_started":1}
I20260812 11:24:55.156983 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.150850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41217 (local address 127.0.0.1:55946)
0812 11:24:55.151429 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.151441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.151525 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.152162 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.152164 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.152182 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:55.152259 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.152263 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.153702 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.153706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.155025 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.155032 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.156385 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.156388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.156480 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.156501 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.156797 (+ 296us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.156869 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"mutex_wait_us":106,"thread_start_us":84,"threads_started":1}
I20260812 11:24:55.157603 14892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.151375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55946 (local address 127.12.175.194:41217)
0812 11:24:55.151766 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.151777 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.151796 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:24:55.151857 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.151861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.152006 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.152173 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:55.152351 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.153494 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.155143 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.156269 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.157273 (+ 1004us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.157389 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.157430 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.157490 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":119,"threads_started":1}
I20260812 11:24:55.158609 14738 tablet_service.cc:1467] Processing CreateTablet for tablet 1101582ab6ac4958beee7cde00525d2b (DEFAULT_TABLE table=test-table [id=8705294ecf0d40799a637bf1163c0817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:55.159257 14237 tablet_service.cc:1467] Processing CreateTablet for tablet 1101582ab6ac4958beee7cde00525d2b (DEFAULT_TABLE table=test-table [id=8705294ecf0d40799a637bf1163c0817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:55.159722 14738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1101582ab6ac4958beee7cde00525d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:55.159775 14490 tablet_service.cc:1467] Processing CreateTablet for tablet 1101582ab6ac4958beee7cde00525d2b (DEFAULT_TABLE table=test-table [id=8705294ecf0d40799a637bf1163c0817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:55.160274 14237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1101582ab6ac4958beee7cde00525d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:55.160561 14490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1101582ab6ac4958beee7cde00525d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:55.166074 14893 tablet_bootstrap.cc:492] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Bootstrap starting.
I20260812 11:24:55.167217 14897 tablet_bootstrap.cc:492] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: Bootstrap starting.
I20260812 11:24:55.168713 14893 tablet_bootstrap.cc:654] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:55.168932 14897 tablet_bootstrap.cc:654] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:55.169904 14897 log.cc:824] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:55.169907 14893 log.cc:824] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:55.170531 14900 tablet_bootstrap.cc:492] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Bootstrap starting.
I20260812 11:24:55.171875 14897 tablet_bootstrap.cc:492] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: No bootstrap required, opened a new log
I20260812 11:24:55.171875 14893 tablet_bootstrap.cc:492] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: No bootstrap required, opened a new log
I20260812 11:24:55.172065 14897 ts_tablet_manager.cc:1397] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:24:55.172077 14893 ts_tablet_manager.cc:1397] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:24:55.172207 14900 tablet_bootstrap.cc:654] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:55.173481 14900 log.cc:824] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:55.175108 14900 tablet_bootstrap.cc:492] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: No bootstrap required, opened a new log
I20260812 11:24:55.175302 14900 ts_tablet_manager.cc:1397] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:24:55.176034 14897 raft_consensus.cc:348] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.176293 14897 raft_consensus.cc:374] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:55.176381 14897 raft_consensus.cc:729] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c1d5e80c30a4cb086a1710168926e00, State: Initialized, Role: FOLLOWER
I20260812 11:24:55.176298 14893 raft_consensus.cc:348] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.176542 14893 raft_consensus.cc:374] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:55.176599 14893 raft_consensus.cc:729] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92f985147a464696a2891baca8476463, State: Initialized, Role: FOLLOWER
I20260812 11:24:55.176828 14897 consensus_queue.cc:260] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.176934 14893 consensus_queue.cc:260] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.177452 14359 heartbeater.cc:503] Master 127.12.175.254:35665 was elected leader, sending a full tablet report...
I20260812 11:24:55.177793 14897 ts_tablet_manager.cc:1428] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:24:55.177793 14893 ts_tablet_manager.cc:1428] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:24:55.178123 14602 heartbeater.cc:503] Master 127.12.175.254:35665 was elected leader, sending a full tablet report...
I20260812 11:24:55.179373 14900 raft_consensus.cc:348] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.179661 14900 raft_consensus.cc:374] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:55.179754 14900 raft_consensus.cc:729] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a286656eff475bbbfe0bf99f1fd190, State: Initialized, Role: FOLLOWER
I20260812 11:24:55.180151 14900 consensus_queue.cc:260] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.180902 14865 heartbeater.cc:503] Master 127.12.175.254:35665 was elected leader, sending a full tablet report...
I20260812 11:24:55.181188 14900 ts_tablet_manager.cc:1428] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
W20260812 11:24:55.205963 14360 tablet.cc:2369] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:55.208560 14913 raft_consensus.cc:482] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:55.208693 14913 raft_consensus.cc:504] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.209635 14913 leader_election.cc:288] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c1d5e80c30a4cb086a1710168926e00 (127.12.175.193:33559), 92f985147a464696a2891baca8476463 (127.12.175.194:41217)
I20260812 11:24:55.214058 14892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.209942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:36125 (local address 127.12.175.194:41217)
0812 11:24:55.210084 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.210089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.210241 (+ 152us) server_negotiation.cc:407] Connection header received
0812 11:24:55.210364 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.210368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.210405 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.210472 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:55.210742 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.211450 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.212790 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.213383 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.213498 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.213556 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.213873 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.213942 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:24:55.214059 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.209874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:50665 (local address 127.12.175.193:33559)
0812 11:24:55.209967 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.209971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.210120 (+ 149us) server_negotiation.cc:407] Connection header received
0812 11:24:55.210166 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.210169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.210208 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.210268 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:55.210521 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.211291 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.212794 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.213383 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.213498 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.213548 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.213881 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.213942 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 11:24:55.214089 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.209789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:33559 (local address 127.12.175.195:50665)
0812 11:24:55.209987 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.210001 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.210085 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.210295 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.210298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.210315 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:55.210412 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.210418 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.211377 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.211380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.212670 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.212681 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.213518 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.213522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.213719 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.213771 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.213847 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.213938 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":90}
I20260812 11:24:55.214103 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.209870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:41217 (local address 127.12.175.195:36125)
0812 11:24:55.210146 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.210159 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.210269 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.210480 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.210483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.210498 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:55.210621 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.210628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.211543 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.211546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.212698 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.212706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.213518 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.213522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.213676 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.213779 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.213851 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.213939 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":77,"thread_start_us":119,"threads_started":1}
I20260812 11:24:55.214756 14520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1101582ab6ac4958beee7cde00525d2b" candidate_uuid: "87a286656eff475bbbfe0bf99f1fd190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92f985147a464696a2891baca8476463" is_pre_election: true
I20260812 11:24:55.214845 14274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1101582ab6ac4958beee7cde00525d2b" candidate_uuid: "87a286656eff475bbbfe0bf99f1fd190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c1d5e80c30a4cb086a1710168926e00" is_pre_election: true
I20260812 11:24:55.214984 14520 raft_consensus.cc:2454] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a286656eff475bbbfe0bf99f1fd190 in term 0.
I20260812 11:24:55.215097 14274 raft_consensus.cc:2454] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a286656eff475bbbfe0bf99f1fd190 in term 0.
I20260812 11:24:55.215541 14654 leader_election.cc:302] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c1d5e80c30a4cb086a1710168926e00, 87a286656eff475bbbfe0bf99f1fd190; no voters:
I20260812 11:24:55.215777 14913 raft_consensus.cc:2781] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:24:55.215858 14913 raft_consensus.cc:482] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:24:55.215906 14913 raft_consensus.cc:3037] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:55.216845 14913 raft_consensus.cc:504] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.217128 14913 leader_election.cc:288] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [CANDIDATE]: Term 1 election: Requested vote from peers 1c1d5e80c30a4cb086a1710168926e00 (127.12.175.193:33559), 92f985147a464696a2891baca8476463 (127.12.175.194:41217)
I20260812 11:24:55.217427 14274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1101582ab6ac4958beee7cde00525d2b" candidate_uuid: "87a286656eff475bbbfe0bf99f1fd190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c1d5e80c30a4cb086a1710168926e00"
I20260812 11:24:55.217444 14520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1101582ab6ac4958beee7cde00525d2b" candidate_uuid: "87a286656eff475bbbfe0bf99f1fd190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92f985147a464696a2891baca8476463"
I20260812 11:24:55.217541 14520 raft_consensus.cc:3037] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:55.217549 14274 raft_consensus.cc:3037] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:55.218726 14520 raft_consensus.cc:2454] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a286656eff475bbbfe0bf99f1fd190 in term 1.
I20260812 11:24:55.218726 14274 raft_consensus.cc:2454] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a286656eff475bbbfe0bf99f1fd190 in term 1.
I20260812 11:24:55.219007 14652 leader_election.cc:302] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a286656eff475bbbfe0bf99f1fd190, 92f985147a464696a2891baca8476463; no voters:
I20260812 11:24:55.219148 14913 raft_consensus.cc:2781] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:55.219372 14913 raft_consensus.cc:686] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 1 LEADER]: Becoming Leader. State: Replica: 87a286656eff475bbbfe0bf99f1fd190, State: Running, Role: LEADER
I20260812 11:24:55.219646 14913 consensus_queue.cc:237] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } }
I20260812 11:24:55.222565 13996 catalog_manager.cc:5495] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a286656eff475bbbfe0bf99f1fd190 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "87a286656eff475bbbfe0bf99f1fd190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a286656eff475bbbfe0bf99f1fd190" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 36645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 } health_report { overall_health: UNKNOWN } } }
I20260812 11:24:55.233248 14891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.230241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60678 (local address 127.12.175.195:36645)
0812 11:24:55.230355 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.230359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.230385 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:24:55.230523 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.230525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.230581 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.230689 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:24:55.230907 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.231388 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.232173 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.232369 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.232432 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.232652 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:24:55.232989 (+ 337us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:24:55.233074 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.233115 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.233159 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:24:55.238075 14274 raft_consensus.cc:1261] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 1 FOLLOWER]: Refusing update from remote peer 87a286656eff475bbbfe0bf99f1fd190: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:55.238094 14520 raft_consensus.cc:1261] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 1 FOLLOWER]: Refusing update from remote peer 87a286656eff475bbbfe0bf99f1fd190: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:55.238687 14924 consensus_queue.cc:1035] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c1d5e80c30a4cb086a1710168926e00" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 33559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:55.238842 14913 consensus_queue.cc:1035] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92f985147a464696a2891baca8476463" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:55.253666 14000 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:55.253798 14000 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:55.255908 14000 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6692504ccbda4f85b92dbe669899e40e: Sending DeleteTablet for 3 replicas of tablet 1101582ab6ac4958beee7cde00525d2b
I20260812 11:24:55.256632 14237 tablet_service.cc:1514] Processing DeleteTablet for tablet 1101582ab6ac4958beee7cde00525d2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:55 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:55184
I20260812 11:24:55.256819 14738 tablet_service.cc:1514] Processing DeleteTablet for tablet 1101582ab6ac4958beee7cde00525d2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:55 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:60672
I20260812 11:24:55.257036 14961 tablet_replica.cc:330] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00: stopping tablet replica
I20260812 11:24:55.257277 14961 raft_consensus.cc:2229] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:55.257251 14490 tablet_service.cc:1514] Processing DeleteTablet for tablet 1101582ab6ac4958beee7cde00525d2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:55 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:55946
I20260812 11:24:55.257561 14961 raft_consensus.cc:2258] T 1101582ab6ac4958beee7cde00525d2b P 1c1d5e80c30a4cb086a1710168926e00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:55.257738 14966 tablet_replica.cc:330] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: stopping tablet replica
I20260812 11:24:55.257802 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14114
I20260812 11:24:55.258430 14966 raft_consensus.cc:2229] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:55.258677 14966 raft_consensus.cc:2258] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:55.264442 14966 ts_tablet_manager.cc:1905] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:55.266462 14966 ts_tablet_manager.cc:1918] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:55.266534 14966 log.cc:1196] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/1101582ab6ac4958beee7cde00525d2b
I20260812 11:24:55.266813 14966 ts_tablet_manager.cc:1939] T 1101582ab6ac4958beee7cde00525d2b P 92f985147a464696a2891baca8476463: Deleting consensus metadata
I20260812 11:24:55.271019 13974 catalog_manager.cc:4841] TS 92f985147a464696a2891baca8476463 (127.12.175.194:41217): tablet 1101582ab6ac4958beee7cde00525d2b (table test-table [id=8705294ecf0d40799a637bf1163c0817]) successfully deleted
I20260812 11:24:55.277902 14963 tablet_replica.cc:330] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: stopping tablet replica
I20260812 11:24:55.278189 14963 raft_consensus.cc:2229] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:24:55.278554 14963 raft_consensus.cc:2258] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:55.282188 14963 ts_tablet_manager.cc:1905] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:55.284358 14963 ts_tablet_manager.cc:1918] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:55.284446 14963 log.cc:1196] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/1101582ab6ac4958beee7cde00525d2b
I20260812 11:24:55.284731 14963 ts_tablet_manager.cc:1939] T 1101582ab6ac4958beee7cde00525d2b P 87a286656eff475bbbfe0bf99f1fd190: Deleting consensus metadata
I20260812 11:24:55.285669 13974 catalog_manager.cc:4841] TS 87a286656eff475bbbfe0bf99f1fd190 (127.12.175.195:36645): tablet 1101582ab6ac4958beee7cde00525d2b (table test-table [id=8705294ecf0d40799a637bf1163c0817]) successfully deleted
W20260812 11:24:55.289297 13975 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:33559 (error 108)
I20260812 11:24:55.290185 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14369
I20260812 11:24:55.290390 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.290025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:33559 (local address 127.0.0.1:55188)
0812 11:24:55.290204 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.290276 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260812 11:24:55.309283 13975 catalog_manager.cc:4584] TS 1c1d5e80c30a4cb086a1710168926e00 (127.12.175.193:33559): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1101582ab6ac4958beee7cde00525d2b: Network error: Client connection negotiation failed: client connection to 127.12.175.193:33559: connect: Connection refused (error 111)
I20260812 11:24:55.315161 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14614
I20260812 11:24:55.323092 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 13950
2026-08-12T11:24:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2360 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T11:24:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:24:55Z Disabled control of system clock
I20260812 11:24:55.356806 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33897
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:33845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:33897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:24:55.462610 14973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:55.462842 14973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:55.462874 14973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:55.466729 14973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:24:55.466778 14973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:55.466792 14973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:55.466807 14973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:24:55.466820 14973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:24:55.471376 14973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:33897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:33897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:55.472258 14973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:55.473461 14973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:55.481321 14985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:55.481333 14982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:55.481572 14973 server_base.cc:1034] running on GCE node
W20260812 11:24:55.481331 14983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:55.482129 14973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:55.483112 14973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:55.484269 14973 hybrid_clock.cc:648] HybridClock initialized: now 1786533895484246 us; error 34 us; skew 500 ppm
I20260812 11:24:55.485906 14973 webserver.cc:460] Webserver started at http://127.12.175.254:39679/ using document root <none> and password file <none>
I20260812 11:24:55.486440 14973 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:55.486505 14973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:55.486745 14973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:55.488682 14973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "e232722314e34abe8c8326c62bc6da2c"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "4ecff673f9d20147a41cbbfe5aadb217"
server_key_iv: "94a6743c751526cbb2c0872f6eaba419"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.489214 14973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "e232722314e34abe8c8326c62bc6da2c"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "4ecff673f9d20147a41cbbfe5aadb217"
server_key_iv: "94a6743c751526cbb2c0872f6eaba419"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.493386 14973 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:24:55.496362 14997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.497947 14973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:24:55.498068 14973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "e232722314e34abe8c8326c62bc6da2c"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "4ecff673f9d20147a41cbbfe5aadb217"
server_key_iv: "94a6743c751526cbb2c0872f6eaba419"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.498171 14973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:55.506801 14973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:55.507402 14973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:55.507551 14973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:55.513684 14973 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:33897
I20260812 11:24:55.513697 15097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:33897 every 8 connection(s)
I20260812 11:24:55.514482 14973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:24:55.517360 15098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:55.521868 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 14973
I20260812 11:24:55.522019 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:24:55.522307 12991 external_mini_cluster.cc:1428] Setting key 64e5dc59d3f82b6d8e3691d47087983d
I20260812 11:24:55.522519 15098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c: Bootstrap starting.
I20260812 11:24:55.524811 15098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:55.525547 15098 log.cc:824] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:55.527416 15098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c: No bootstrap required, opened a new log
I20260812 11:24:55.530797 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.523575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55238 (local address 127.12.175.254:33897)
0812 11:24:55.524138 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.524151 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.524184 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:24:55.524762 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.524778 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.525168 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.525426 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:55.525761 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.526679 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.527868 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.528336 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.528456 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.529270 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:55.529276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:55.529287 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:55.529620 (+ 333us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:55.529672 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:55.529690 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:55.529760 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.529898 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.530159 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":104,"threads_started":1}
I20260812 11:24:55.531073 15098 raft_consensus.cc:348] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e232722314e34abe8c8326c62bc6da2c" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33897 } }
I20260812 11:24:55.531286 15098 raft_consensus.cc:374] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:55.531351 15098 raft_consensus.cc:729] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e232722314e34abe8c8326c62bc6da2c, State: Initialized, Role: FOLLOWER
I20260812 11:24:55.531728 15098 consensus_queue.cc:260] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e232722314e34abe8c8326c62bc6da2c" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33897 } }
I20260812 11:24:55.531879 15098 raft_consensus.cc:388] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:24:55.531944 15098 raft_consensus.cc:482] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:24:55.532042 15098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:55.532946 15098 raft_consensus.cc:504] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e232722314e34abe8c8326c62bc6da2c" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33897 } }
I20260812 11:24:55.533223 15098 leader_election.cc:302] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e232722314e34abe8c8326c62bc6da2c; no voters:
I20260812 11:24:55.533443 15098 leader_election.cc:288] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:24:55.533541 15112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:55.533733 15112 raft_consensus.cc:686] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [term 1 LEADER]: Becoming Leader. State: Replica: e232722314e34abe8c8326c62bc6da2c, State: Running, Role: LEADER
I20260812 11:24:55.534034 15112 consensus_queue.cc:237] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e232722314e34abe8c8326c62bc6da2c" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33897 } }
I20260812 11:24:55.534420 15098 sys_catalog.cc:564] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:24:55.535419 15114 sys_catalog.cc:455] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e232722314e34abe8c8326c62bc6da2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e232722314e34abe8c8326c62bc6da2c" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33897 } } }
I20260812 11:24:55.535547 15114 sys_catalog.cc:458] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:55.535898 15130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:24:55.535936 15115 sys_catalog.cc:455] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e232722314e34abe8c8326c62bc6da2c. Latest consensus state: current_term: 1 leader_uuid: "e232722314e34abe8c8326c62bc6da2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e232722314e34abe8c8326c62bc6da2c" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 33897 } } }
I20260812 11:24:55.536098 15115 sys_catalog.cc:458] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:55.538861 15130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:24:55.543905 15130 catalog_manager.cc:1347] Generated new cluster ID: 402ab03c2fc747f388d95e0e17aaa09c
I20260812 11:24:55.543967 15130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:24:55.576150 15130 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:24:55.576917 15130 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:24:55.583782 15130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c: Generated new TSK 0
I20260812 11:24:55.584328 15130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:24:55.587662 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33897
--builtin_ntp_servers=127.12.175.212:33845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:24:55.720558 15146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:55.720769 15146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:55.720803 15146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:55.724668 15146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:55.724709 15146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:55.724758 15146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:24:55.729197 15146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:55.730036 15146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:55.731212 15146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:55.740099 15156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:55.740106 15155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:55.740106 15158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:55.740302 15146 server_base.cc:1034] running on GCE node
I20260812 11:24:55.740741 15146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:55.741287 15146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:55.742437 15146 hybrid_clock.cc:648] HybridClock initialized: now 1786533895742418 us; error 31 us; skew 500 ppm
I20260812 11:24:55.744068 15146 webserver.cc:460] Webserver started at http://127.12.175.193:41229/ using document root <none> and password file <none>
I20260812 11:24:55.744587 15146 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:55.744647 15146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:55.744803 15146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:55.746641 15146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "f2e77e35e02444729b9d11ba04ace92e"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "734072238b7216c2781622e45887a166"
server_key_iv: "73ef7a68ea198df872c557ff56ec485b"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.747120 15146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "f2e77e35e02444729b9d11ba04ace92e"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "734072238b7216c2781622e45887a166"
server_key_iv: "73ef7a68ea198df872c557ff56ec485b"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.750442 15146 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260812 11:24:55.752645 15167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.753718 15146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:24:55.753829 15146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "f2e77e35e02444729b9d11ba04ace92e"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "734072238b7216c2781622e45887a166"
server_key_iv: "73ef7a68ea198df872c557ff56ec485b"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.753916 15146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:55.771253 15146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:55.771839 15146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:55.771989 15146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:55.772478 15146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:55.773301 15146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:55.773347 15146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.773394 15146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:55.773422 15146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.781510 15146 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:44481
I20260812 11:24:55.781530 15371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:44481 every 8 connection(s)
I20260812 11:24:55.782274 15146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:24:55.784832 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15146
I20260812 11:24:55.784951 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:24:55.785220 12991 external_mini_cluster.cc:1428] Setting key 596a5809a1583ce8523c08ce72ad8b4c
I20260812 11:24:55.787179 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33897
--builtin_ntp_servers=127.12.175.212:33845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:24:55.790824 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.783849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:40315 (local address 127.12.175.254:33897)
0812 11:24:55.783964 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.783968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.784895 (+ 927us) server_negotiation.cc:407] Connection header received
0812 11:24:55.786379 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.786382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.786423 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.786500 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:55.787400 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.787924 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.789022 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.789354 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.789460 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.790418 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:55.790421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:55.790423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:55.790435 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:55.790454 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:55.790462 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:55.790518 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.790670 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.790720 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:24:55.791862 15377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.784167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33897 (local address 127.12.175.193:40315)
0812 11:24:55.784756 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.784792 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.786160 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.786690 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.786698 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.786795 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:55.787225 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.787237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.788055 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.788057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.788906 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.788915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.789477 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.789480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.789623 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.790146 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:24:55.790148 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:55.790196 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:24:55.790267 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:55.790542 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:55.790551 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:55.790557 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.790673 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.790923 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
I20260812 11:24:55.792938 15373 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33897
I20260812 11:24:55.793167 15373 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:55.793735 15373 heartbeater.cc:511] Master 127.12.175.254:33897 requested a full tablet report, sending...
I20260812 11:24:55.795142 15032 ts_manager.cc:194] Registered new tserver with Master: f2e77e35e02444729b9d11ba04ace92e (127.12.175.193:44481)
I20260812 11:24:55.796237 15032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.193:40315
W20260812 11:24:55.894322 15378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:55.894538 15378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:55.894585 15378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:55.898418 15378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:55.898463 15378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:55.898532 15378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:24:55.903478 15378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:55.904358 15378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:55.905542 15378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:55.914129 15394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:55.914101 15389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:55.914110 15388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:55.914377 15378 server_base.cc:1034] running on GCE node
I20260812 11:24:55.914706 15378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:55.915226 15378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:55.916388 15378 hybrid_clock.cc:648] HybridClock initialized: now 1786533895916367 us; error 35 us; skew 500 ppm
I20260812 11:24:55.917886 15378 webserver.cc:460] Webserver started at http://127.12.175.194:41865/ using document root <none> and password file <none>
I20260812 11:24:55.918366 15378 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:55.918421 15378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:55.918576 15378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:55.920382 15378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "b3f02d49b5234a9e95df33c7103360ea"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "88863e524c5babe899118ca9623049fd"
server_key_iv: "23972566d4024505339739610ed82ca3"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.920846 15378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "b3f02d49b5234a9e95df33c7103360ea"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "88863e524c5babe899118ca9623049fd"
server_key_iv: "23972566d4024505339739610ed82ca3"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.924149 15378 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:24:55.926185 15402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.927230 15378 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:55.927352 15378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "b3f02d49b5234a9e95df33c7103360ea"
format_stamp: "Formatted at 2026-08-12 11:24:55 on dist-test-slave-gjrz"
server_key: "88863e524c5babe899118ca9623049fd"
server_key_iv: "23972566d4024505339739610ed82ca3"
server_key_version: "encryptionkey@0"
I20260812 11:24:55.927445 15378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:55.948046 15378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:55.948701 15378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:55.948870 15378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:55.949492 15378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:55.950557 15378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:55.950623 15378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.950673 15378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:55.950707 15378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:55.962442 15378 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:45145
I20260812 11:24:55.962467 15615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:45145 every 8 connection(s)
I20260812 11:24:55.963234 15378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:24:55.964085 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15378
I20260812 11:24:55.964208 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:24:55.964504 12991 external_mini_cluster.cc:1428] Setting key a2ac1478667181c2b33ba683481a63d7
I20260812 11:24:55.966486 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33897
--builtin_ntp_servers=127.12.175.212:33845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:24:55.972604 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.965004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:43787 (local address 127.12.175.254:33897)
0812 11:24:55.965146 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:55.965151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:55.966202 (+ 1051us) server_negotiation.cc:407] Connection header received
0812 11:24:55.967869 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:55.967872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:55.967917 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:55.967984 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:55.968903 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.969670 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.970734 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.971066 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.971176 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.972131 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:55.972136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:55.972139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:55.972153 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:55.972176 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:55.972186 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:55.972264 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:55.972382 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 11:24:55.972446 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:24:55.973284 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:55.965376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33897 (local address 127.12.175.194:43787)
0812 11:24:55.966048 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:55.966104 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:55.967663 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:55.968156 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:55.968164 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:55.968272 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:55.968770 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.968783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.969776 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.969778 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.970610 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:55.970619 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:55.971200 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:55.971203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:55.971383 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:55.971885 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:24:55.971887 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:55.971925 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:24:55.971983 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:55.972264 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:55.972270 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:55.972274 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:24:55.972360 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:24:55.972556 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":115,"threads_started":1}
I20260812 11:24:55.974251 15616 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33897
I20260812 11:24:55.974483 15616 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:55.975085 15616 heartbeater.cc:511] Master 127.12.175.254:33897 requested a full tablet report, sending...
I20260812 11:24:55.976704 15032 ts_manager.cc:194] Registered new tserver with Master: b3f02d49b5234a9e95df33c7103360ea (127.12.175.194:45145)
I20260812 11:24:55.977260 15032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.194:43787
W20260812 11:24:56.075181 15619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:56.075438 15619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:56.075481 15619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:56.079356 15619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:56.079399 15619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:56.079448 15619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:24:56.084115 15619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:33897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:56.084990 15619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:56.086179 15619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:56.094849 15630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:56.094820 15635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:56.094838 15632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:56.095003 15619 server_base.cc:1034] running on GCE node
I20260812 11:24:56.095474 15619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:56.096019 15619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:56.097162 15619 hybrid_clock.cc:648] HybridClock initialized: now 1786533896097140 us; error 34 us; skew 500 ppm
I20260812 11:24:56.098819 15619 webserver.cc:460] Webserver started at http://127.12.175.195:40803/ using document root <none> and password file <none>
I20260812 11:24:56.099354 15619 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:56.099416 15619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:56.099614 15619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:56.101495 15619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "03cb8604b7bd49218e501149f7dde9ea"
format_stamp: "Formatted at 2026-08-12 11:24:56 on dist-test-slave-gjrz"
server_key: "7b8b6ab2878ffb77fc8025de687a6713"
server_key_iv: "9ac8499fc9db5508ebd4dd27ce93e569"
server_key_version: "encryptionkey@0"
I20260812 11:24:56.102033 15619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "03cb8604b7bd49218e501149f7dde9ea"
format_stamp: "Formatted at 2026-08-12 11:24:56 on dist-test-slave-gjrz"
server_key: "7b8b6ab2878ffb77fc8025de687a6713"
server_key_iv: "9ac8499fc9db5508ebd4dd27ce93e569"
server_key_version: "encryptionkey@0"
I20260812 11:24:56.105631 15619 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 11:24:56.107856 15641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:56.109014 15619 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:56.109107 15619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "03cb8604b7bd49218e501149f7dde9ea"
format_stamp: "Formatted at 2026-08-12 11:24:56 on dist-test-slave-gjrz"
server_key: "7b8b6ab2878ffb77fc8025de687a6713"
server_key_iv: "9ac8499fc9db5508ebd4dd27ce93e569"
server_key_version: "encryptionkey@0"
I20260812 11:24:56.109203 15619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:56.123999 15619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:56.124537 15619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:56.124679 15619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:56.125173 15619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:56.125989 15619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:56.126034 15619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:56.126072 15619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:56.126101 15619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:56.134202 15619 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:40203
I20260812 11:24:56.134227 15829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:40203 every 8 connection(s)
I20260812 11:24:56.135020 15619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:24:56.143162 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15619
I20260812 11:24:56.143252 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.136766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:43085 (local address 127.12.175.254:33897)
0812 11:24:56.136901 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.136905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.137923 (+ 1018us) server_negotiation.cc:407] Connection header received
0812 11:24:56.139214 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.139217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.139305 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.139388 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:56.140152 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.140657 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.141676 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.141889 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.141954 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.142817 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:56.142820 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:56.142822 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:56.142833 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:56.142853 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:56.142861 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:56.142933 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.143044 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.143107 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:24:56.143292 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:24:56.143574 12991 external_mini_cluster.cc:1428] Setting key 51a14098ada5d15dd6aa0ff442504d39
I20260812 11:24:56.143997 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.137173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:33897 (local address 127.12.175.195:43085)
0812 11:24:56.137784 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.137820 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:56.139023 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:56.139520 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:56.139526 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:56.139603 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:56.140044 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.140056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.140742 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.140745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.141591 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.141600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.141989 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.141991 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.142123 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.142595 (+ 472us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:24:56.142597 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:56.142632 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:24:56.142689 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:56.142934 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:56.142938 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:56.142942 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:24:56.143019 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:24:56.143212 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":110,"threads_started":1}
I20260812 11:24:56.145037 15830 heartbeater.cc:347] Connected to a master server at 127.12.175.254:33897
I20260812 11:24:56.145236 15830 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:56.145731 15830 heartbeater.cc:511] Master 127.12.175.254:33897 requested a full tablet report, sending...
I20260812 11:24:56.146629 15032 ts_manager.cc:194] Registered new tserver with Master: 03cb8604b7bd49218e501149f7dde9ea (127.12.175.195:40203)
I20260812 11:24:56.147158 15032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.195:43085
I20260812 11:24:56.157058 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:24:56.161989 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.158909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55250 (local address 127.12.175.254:33897)
0812 11:24:56.159033 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.159037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.159160 (+ 123us) server_negotiation.cc:407] Connection header received
0812 11:24:56.159251 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.159253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.159314 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.159374 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:56.159608 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.160082 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.160807 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.161000 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.161061 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.161657 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:56.161660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:56.161662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:56.161672 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:56.161689 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:56.161696 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:56.161749 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.161810 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.161854 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:24:56.164381 15032 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:24:56.167162 15032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:24:56.180019 15851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.174867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44481 (local address 127.0.0.1:39880)
0812 11:24:56.175430 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.175475 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:56.175610 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:56.176332 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:56.176338 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:56.176361 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:56.176480 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.176488 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.177639 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.177642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.178590 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.178601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.179485 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.179488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.179608 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.179654 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 11:24:56.179759 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:24:56.179871 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":1,"thread_start_us":54,"threads_started":1}
I20260812 11:24:56.180282 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.175067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39880 (local address 127.12.175.193:44481)
0812 11:24:56.175711 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.175723 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.175745 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:24:56.175810 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.175814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.176006 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.176161 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:56.176587 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.177542 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.178731 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.179365 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.179482 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.179656 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.180059 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.180160 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":112,"threads_started":1}
I20260812 11:24:56.181507 15854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.175080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40203 (local address 127.0.0.1:56310)
0812 11:24:56.175585 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.175599 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:56.175692 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:56.176875 (+ 1183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:56.176878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:56.176897 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:56.176998 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.177003 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.178339 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.178343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.180063 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.180075 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.181132 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.181136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.181222 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.181248 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:24:56.181315 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:24:56.181381 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":61,"thread_start_us":104,"threads_started":1}
I20260812 11:24:56.181571 15859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.175867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56310 (local address 127.12.175.195:40203)
0812 11:24:56.176452 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.176463 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.176486 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:24:56.176555 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.176560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.176732 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.176875 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:56.177111 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.178222 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.180357 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.180978 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.181138 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.181291 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.181342 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.181423 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":114,"threads_started":1}
I20260812 11:24:56.181870 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.175543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:45145 (local address 127.0.0.1:58596)
0812 11:24:56.176389 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.176402 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:56.176496 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:56.177170 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:56.177173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:56.177189 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:56.177257 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.177261 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.178536 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.178539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.180529 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.180540 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.181521 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.181525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.181620 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.181644 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:24:56.181692 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 11:24:56.181757 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260812 11:24:56.182544 15860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.175954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58596 (local address 127.12.175.194:45145)
0812 11:24:56.176727 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.176741 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.176763 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:24:56.176836 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.176841 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.177009 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.177184 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:56.177350 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.178402 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.180648 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.181383 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.182068 (+ 685us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.182234 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.182284 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.182372 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":110,"threads_started":1}
I20260812 11:24:56.183303 15258 tablet_service.cc:1467] Processing CreateTablet for tablet 6439827cfcdd473092f9bf3323a9df16 (DEFAULT_TABLE table=test-table [id=26fa8ecc81514325a1795ed2ebb8ed64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:56.184422 15258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6439827cfcdd473092f9bf3323a9df16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:56.184410 15732 tablet_service.cc:1467] Processing CreateTablet for tablet 6439827cfcdd473092f9bf3323a9df16 (DEFAULT_TABLE table=test-table [id=26fa8ecc81514325a1795ed2ebb8ed64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:56.185412 15732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6439827cfcdd473092f9bf3323a9df16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:56.191762 15861 tablet_bootstrap.cc:492] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: Bootstrap starting.
I20260812 11:24:56.193001 15863 tablet_bootstrap.cc:492] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Bootstrap starting.
I20260812 11:24:56.193148 15486 tablet_service.cc:1467] Processing CreateTablet for tablet 6439827cfcdd473092f9bf3323a9df16 (DEFAULT_TABLE table=test-table [id=26fa8ecc81514325a1795ed2ebb8ed64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:56.194126 15486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6439827cfcdd473092f9bf3323a9df16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:56.194317 15861 tablet_bootstrap.cc:654] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:56.194728 15863 tablet_bootstrap.cc:654] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:56.195168 15861 log.cc:824] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:56.195506 15863 log.cc:824] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:56.197288 15861 tablet_bootstrap.cc:492] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: No bootstrap required, opened a new log
I20260812 11:24:56.197288 15863 tablet_bootstrap.cc:492] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: No bootstrap required, opened a new log
I20260812 11:24:56.197477 15863 ts_tablet_manager.cc:1397] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 11:24:56.197477 15861 ts_tablet_manager.cc:1397] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:24:56.199754 15866 tablet_bootstrap.cc:492] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Bootstrap starting.
I20260812 11:24:56.201794 15866 tablet_bootstrap.cc:654] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:56.201712 15863 raft_consensus.cc:348] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.201712 15861 raft_consensus.cc:348] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.202005 15863 raft_consensus.cc:374] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:56.202055 15861 raft_consensus.cc:374] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:56.202087 15863 raft_consensus.cc:729] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cb8604b7bd49218e501149f7dde9ea, State: Initialized, Role: FOLLOWER
I20260812 11:24:56.202167 15861 raft_consensus.cc:729] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e77e35e02444729b9d11ba04ace92e, State: Initialized, Role: FOLLOWER
I20260812 11:24:56.202567 15866 log.cc:824] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:56.202534 15863 consensus_queue.cc:260] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.202545 15861 consensus_queue.cc:260] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.203171 15830 heartbeater.cc:503] Master 127.12.175.254:33897 was elected leader, sending a full tablet report...
I20260812 11:24:56.203414 15373 heartbeater.cc:503] Master 127.12.175.254:33897 was elected leader, sending a full tablet report...
I20260812 11:24:56.203511 15863 ts_tablet_manager.cc:1428] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260812 11:24:56.204098 15861 ts_tablet_manager.cc:1428] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:24:56.204933 15866 tablet_bootstrap.cc:492] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: No bootstrap required, opened a new log
I20260812 11:24:56.205114 15866 ts_tablet_manager.cc:1397] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:24:56.208554 15866 raft_consensus.cc:348] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.208751 15866 raft_consensus.cc:374] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:56.208806 15866 raft_consensus.cc:729] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f02d49b5234a9e95df33c7103360ea, State: Initialized, Role: FOLLOWER
I20260812 11:24:56.209142 15866 consensus_queue.cc:260] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.209662 15616 heartbeater.cc:503] Master 127.12.175.254:33897 was elected leader, sending a full tablet report...
I20260812 11:24:56.209955 15866 ts_tablet_manager.cc:1428] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260812 11:24:56.215065 15617 tablet.cc:2369] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:56.250293 15867 raft_consensus.cc:482] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:56.250447 15867 raft_consensus.cc:504] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.251405 15867 leader_election.cc:288] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cb8604b7bd49218e501149f7dde9ea (127.12.175.195:40203), b3f02d49b5234a9e95df33c7103360ea (127.12.175.194:45145)
I20260812 11:24:56.255316 15859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.251687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:57965 (local address 127.12.175.195:40203)
0812 11:24:56.251804 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.251808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.251822 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:24:56.252054 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.252057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.252104 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.252170 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:56.252476 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.252966 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.254366 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.254762 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.254867 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.254918 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.255128 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.255193 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:24:56.255343 15377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.251588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:40203 (local address 127.12.175.193:57965)
0812 11:24:56.251705 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.251719 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:56.251809 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:56.252197 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:56.252200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:56.252219 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:56.252358 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.252367 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.253077 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.253080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.254249 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.254258 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.254868 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.254871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.255007 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.255031 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:24:56.255110 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 11:24:56.255181 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"spinlock_wait_cycles":16256}
I20260812 11:24:56.255908 15765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6439827cfcdd473092f9bf3323a9df16" candidate_uuid: "f2e77e35e02444729b9d11ba04ace92e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cb8604b7bd49218e501149f7dde9ea" is_pre_election: true
I20260812 11:24:56.256093 15860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.251940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:38065 (local address 127.12.175.194:45145)
0812 11:24:56.252056 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.252060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.252275 (+ 215us) server_negotiation.cc:407] Connection header received
0812 11:24:56.252327 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.252330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.252370 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.252451 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:56.253320 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.254075 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.255038 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.255625 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.255710 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.255741 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.255940 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.255990 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:24:56.256146 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.251844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:45145 (local address 127.12.175.193:38065)
0812 11:24:56.252121 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.252132 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:56.252254 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:56.253092 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:56.253094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:56.253111 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:56.253212 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.253217 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.254194 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.254196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.254926 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:56.254934 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.255726 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.255730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:56.255823 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.255849 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:24:56.255930 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:24:56.256009 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"spinlock_wait_cycles":4736,"thread_start_us":101,"threads_started":1}
I20260812 11:24:56.256196 15765 raft_consensus.cc:2454] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2e77e35e02444729b9d11ba04ace92e in term 0.
I20260812 11:24:56.256628 15169 leader_election.cc:302] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cb8604b7bd49218e501149f7dde9ea, f2e77e35e02444729b9d11ba04ace92e; no voters:
I20260812 11:24:56.256789 15525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6439827cfcdd473092f9bf3323a9df16" candidate_uuid: "f2e77e35e02444729b9d11ba04ace92e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3f02d49b5234a9e95df33c7103360ea" is_pre_election: true
I20260812 11:24:56.256877 15867 raft_consensus.cc:2781] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:24:56.256968 15867 raft_consensus.cc:482] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:24:56.257018 15867 raft_consensus.cc:3037] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:56.257063 15525 raft_consensus.cc:2454] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2e77e35e02444729b9d11ba04ace92e in term 0.
I20260812 11:24:56.258159 15867 raft_consensus.cc:504] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.258492 15867 leader_election.cc:288] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [CANDIDATE]: Term 1 election: Requested vote from peers 03cb8604b7bd49218e501149f7dde9ea (127.12.175.195:40203), b3f02d49b5234a9e95df33c7103360ea (127.12.175.194:45145)
I20260812 11:24:56.258782 15765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6439827cfcdd473092f9bf3323a9df16" candidate_uuid: "f2e77e35e02444729b9d11ba04ace92e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cb8604b7bd49218e501149f7dde9ea"
I20260812 11:24:56.258827 15525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6439827cfcdd473092f9bf3323a9df16" candidate_uuid: "f2e77e35e02444729b9d11ba04ace92e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3f02d49b5234a9e95df33c7103360ea"
I20260812 11:24:56.258891 15765 raft_consensus.cc:3037] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:56.258935 15525 raft_consensus.cc:3037] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:56.259900 15765 raft_consensus.cc:2454] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2e77e35e02444729b9d11ba04ace92e in term 1.
I20260812 11:24:56.260025 15525 raft_consensus.cc:2454] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2e77e35e02444729b9d11ba04ace92e in term 1.
I20260812 11:24:56.260182 15169 leader_election.cc:302] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cb8604b7bd49218e501149f7dde9ea, f2e77e35e02444729b9d11ba04ace92e; no voters:
I20260812 11:24:56.260355 15867 raft_consensus.cc:2781] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:56.260540 15867 raft_consensus.cc:686] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 1 LEADER]: Becoming Leader. State: Replica: f2e77e35e02444729b9d11ba04ace92e, State: Running, Role: LEADER
I20260812 11:24:56.260802 15867 consensus_queue.cc:237] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } }
I20260812 11:24:56.263676 15032 catalog_manager.cc:5495] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e reported cstate change: term changed from 0 to 1, leader changed from <none> to f2e77e35e02444729b9d11ba04ace92e (127.12.175.193). New cstate: current_term: 1 leader_uuid: "f2e77e35e02444729b9d11ba04ace92e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e77e35e02444729b9d11ba04ace92e" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 } health_report { overall_health: UNKNOWN } } }
I20260812 11:24:56.280035 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.276811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39896 (local address 127.12.175.193:44481)
0812 11:24:56.276919 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:56.276924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:56.276937 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:24:56.277094 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:56.277096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:56.277143 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:56.277226 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:24:56.277452 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.277926 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.278778 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:56.278996 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:56.279074 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:56.279359 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:24:56.279719 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:24:56.279805 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:56.279880 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:24:56.279923 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 11:24:56.283294 15374 tablet.cc:2369] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:56.285266 15525 raft_consensus.cc:1261] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 1 FOLLOWER]: Refusing update from remote peer f2e77e35e02444729b9d11ba04ace92e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:56.285279 15765 raft_consensus.cc:1261] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 1 FOLLOWER]: Refusing update from remote peer f2e77e35e02444729b9d11ba04ace92e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:56.285851 15867 consensus_queue.cc:1035] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cb8604b7bd49218e501149f7dde9ea" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 40203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:56.286048 15874 consensus_queue.cc:1035] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3f02d49b5234a9e95df33c7103360ea" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 45145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:56.294669 15886 mvcc.cc:205] Tried to move back new op lower bound from 7317642839178375168 to 7317642839086391296. Current Snapshot: MvccSnapshot[applied={T|T < 7317642839178375168}]
I20260812 11:24:56.296813 15882 mvcc.cc:205] Tried to move back new op lower bound from 7317642839178375168 to 7317642839086391296. Current Snapshot: MvccSnapshot[applied={T|T < 7317642839178375168 or (T in {7317642839178375168})}]
I20260812 11:24:56.300304 15029 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:56.300455 15029 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:56.302753 15029 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e232722314e34abe8c8326c62bc6da2c: Sending DeleteTablet for 3 replicas of tablet 6439827cfcdd473092f9bf3323a9df16
I20260812 11:24:56.303450 15258 tablet_service.cc:1514] Processing DeleteTablet for tablet 6439827cfcdd473092f9bf3323a9df16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:56 UTC) from {username='slave'} at 127.0.0.1:39880
I20260812 11:24:56.303516 15732 tablet_service.cc:1514] Processing DeleteTablet for tablet 6439827cfcdd473092f9bf3323a9df16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:56 UTC) from {username='slave'} at 127.0.0.1:56310
I20260812 11:24:56.303915 15486 tablet_service.cc:1514] Processing DeleteTablet for tablet 6439827cfcdd473092f9bf3323a9df16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:56 UTC) from {username='slave'} at 127.0.0.1:58596
I20260812 11:24:56.304059 15900 tablet_replica.cc:330] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e: stopping tablet replica
I20260812 11:24:56.304221 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15146
I20260812 11:24:56.304324 15900 raft_consensus.cc:2229] T 6439827cfcdd473092f9bf3323a9df16 P f2e77e35e02444729b9d11ba04ace92e [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:24:56.307643 15901 tablet_replica.cc:330] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: stopping tablet replica
I20260812 11:24:56.307830 15901 raft_consensus.cc:2229] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:56.308033 15901 raft_consensus.cc:2258] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:56.308291 15898 tablet_replica.cc:330] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: stopping tablet replica
I20260812 11:24:56.308511 15898 raft_consensus.cc:2229] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:56.308717 15898 raft_consensus.cc:2258] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:56.310685 15901 ts_tablet_manager.cc:1905] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:56.311372 15898 ts_tablet_manager.cc:1905] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:56.313452 15901 ts_tablet_manager.cc:1918] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:56.313643 15901 log.cc:1196] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/6439827cfcdd473092f9bf3323a9df16
I20260812 11:24:56.314047 15901 ts_tablet_manager.cc:1939] T 6439827cfcdd473092f9bf3323a9df16 P b3f02d49b5234a9e95df33c7103360ea: Deleting consensus metadata
I20260812 11:24:56.314642 15898 ts_tablet_manager.cc:1918] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:56.314801 15898 log.cc:1196] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/6439827cfcdd473092f9bf3323a9df16
I20260812 11:24:56.315158 15898 ts_tablet_manager.cc:1939] T 6439827cfcdd473092f9bf3323a9df16 P 03cb8604b7bd49218e501149f7dde9ea: Deleting consensus metadata
I20260812 11:24:56.315675 14999 catalog_manager.cc:4841] TS b3f02d49b5234a9e95df33c7103360ea (127.12.175.194:45145): tablet 6439827cfcdd473092f9bf3323a9df16 (table test-table [id=26fa8ecc81514325a1795ed2ebb8ed64]) successfully deleted
I20260812 11:24:56.316257 14999 catalog_manager.cc:4841] TS 03cb8604b7bd49218e501149f7dde9ea (127.12.175.195:40203): tablet 6439827cfcdd473092f9bf3323a9df16 (table test-table [id=26fa8ecc81514325a1795ed2ebb8ed64]) successfully deleted
W20260812 11:24:56.321475 15002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:44481 (error 108)
I20260812 11:24:56.321615 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15378
I20260812 11:24:56.327198 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:56.325960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44481 (local address 127.0.0.1:39912)
0812 11:24:56.327053 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:56.327123 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:44481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1007}
W20260812 11:24:56.327368 15002 catalog_manager.cc:4584] TS f2e77e35e02444729b9d11ba04ace92e (127.12.175.193:44481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6439827cfcdd473092f9bf3323a9df16: Network error: Client connection negotiation failed: client connection to 127.12.175.193:44481: connect: Connection refused (error 111)
I20260812 11:24:56.331679 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15619
I20260812 11:24:56.347657 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 14973
2026-08-12T11:24:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1029 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:24:56 dist-test-slave-gjrz krb5kdc[15910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:24:56 dist-test-slave-gjrz krb5kdc[15910](info): set up 2 sockets
Aug 12 11:24:56 dist-test-slave-gjrz krb5kdc[15910](info): commencing operation
krb5kdc: starting...
W20260812 11:24:57.550366 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:24:57 dist-test-slave-gjrz krb5kdc[15910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:24:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:24:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:24:57.679198 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39687
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39687
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:57.784054 15936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:57.784265 15936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:57.784300 15936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:57.788085 15936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:24:57.788125 15936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:57.788142 15936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:57.788156 15936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:24:57.788169 15936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:24:57.793030 15936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:57.793825 15936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:57.794652 15936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:57.802350 15945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:57.802369 15947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:57.802371 15949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:57.802541 15936 server_base.cc:1034] running on GCE node
I20260812 11:24:57.803117 15936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:57.804134 15936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:57.805295 15936 hybrid_clock.cc:648] HybridClock initialized: now 1786533897805281 us; error 28 us; skew 500 ppm
Aug 12 11:24:57 dist-test-slave-gjrz krb5kdc[15910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533897, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:57.807793 15936 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:24:57.808573 15936 webserver.cc:460] Webserver started at http://127.12.175.254:44137/ using document root <none> and password file <none>
I20260812 11:24:57.809053 15936 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:57.809118 15936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:57.809304 15936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:57.811120 15936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "d44b585579324deda4b34111863c86b3"
format_stamp: "Formatted at 2026-08-12 11:24:57 on dist-test-slave-gjrz"
server_key: "7fc3ff35d44d8fc28b7ab2bca8249cdf"
server_key_iv: "02563d4aac23ff6d73aeea362cecca7c"
server_key_version: "encryptionkey@0"
I20260812 11:24:57.811671 15936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "d44b585579324deda4b34111863c86b3"
format_stamp: "Formatted at 2026-08-12 11:24:57 on dist-test-slave-gjrz"
server_key: "7fc3ff35d44d8fc28b7ab2bca8249cdf"
server_key_iv: "02563d4aac23ff6d73aeea362cecca7c"
server_key_version: "encryptionkey@0"
I20260812 11:24:57.814987 15936 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:24:57.817203 15960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:57.818274 15936 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:57.818390 15936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "d44b585579324deda4b34111863c86b3"
format_stamp: "Formatted at 2026-08-12 11:24:57 on dist-test-slave-gjrz"
server_key: "7fc3ff35d44d8fc28b7ab2bca8249cdf"
server_key_iv: "02563d4aac23ff6d73aeea362cecca7c"
server_key_version: "encryptionkey@0"
I20260812 11:24:57.818480 15936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:57.838163 15936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:57.840619 15936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:57.840778 15936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:57.847066 15936 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39687
I20260812 11:24:57.847136 16049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39687 every 8 connection(s)
I20260812 11:24:57.847919 15936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:24:57.850411 16051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:57.854310 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 15936
I20260812 11:24:57.854434 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:24:57.854697 12991 external_mini_cluster.cc:1428] Setting key 55e9d51ffe67a5e8a1509896820eb6f5
I20260812 11:24:57.855542 16051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3: Bootstrap starting.
I20260812 11:24:57.857633 16051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:57.858492 16051 log.cc:824] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:57.860371 16051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3: No bootstrap required, opened a new log
Aug 12 11:24:57 dist-test-slave-gjrz krb5kdc[15910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:57.864298 16051 raft_consensus.cc:348] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44b585579324deda4b34111863c86b3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39687 } }
I20260812 11:24:57.864499 16051 raft_consensus.cc:374] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:57.864553 16051 raft_consensus.cc:729] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44b585579324deda4b34111863c86b3, State: Initialized, Role: FOLLOWER
I20260812 11:24:57.864956 16051 consensus_queue.cc:260] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44b585579324deda4b34111863c86b3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39687 } }
I20260812 11:24:57.865089 16051 raft_consensus.cc:388] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:24:57.865155 16051 raft_consensus.cc:482] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:24:57.865248 16051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:57.866158 16051 raft_consensus.cc:504] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44b585579324deda4b34111863c86b3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39687 } }
I20260812 11:24:57.866470 16051 leader_election.cc:302] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d44b585579324deda4b34111863c86b3; no voters:
I20260812 11:24:57.866734 16051 leader_election.cc:288] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:24:57.866851 16057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:57.867069 16057 raft_consensus.cc:686] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [term 1 LEADER]: Becoming Leader. State: Replica: d44b585579324deda4b34111863c86b3, State: Running, Role: LEADER
I20260812 11:24:57.867568 16057 consensus_queue.cc:237] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44b585579324deda4b34111863c86b3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39687 } }
I20260812 11:24:57.867985 16051 sys_catalog.cc:564] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:24:57.868608 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:57.855918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42970 (local address 127.12.175.254:39687)
0812 11:24:57.856275 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:57.856291 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:57.856324 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:24:57.856926 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:57.856943 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:57.857241 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:57.857506 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:57.858384 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:57.859404 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:57.860523 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:57.860985 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:57.861099 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:57.863730 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:57.863735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:57.863747 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:57.863772 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:57.865344 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:57.865789 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:57.865794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:57.865798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:57.865931 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:57.866225 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:57.866228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:57.866229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:57.866639 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:57.866810 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:57.867410 (+ 600us) server_negotiation.cc:299] Negotiation successful
0812 11:24:57.867692 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":91,"threads_started":1}
I20260812 11:24:57.869277 16060 sys_catalog.cc:455] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d44b585579324deda4b34111863c86b3. Latest consensus state: current_term: 1 leader_uuid: "d44b585579324deda4b34111863c86b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44b585579324deda4b34111863c86b3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39687 } } }
I20260812 11:24:57.869277 16058 sys_catalog.cc:455] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d44b585579324deda4b34111863c86b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44b585579324deda4b34111863c86b3" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39687 } } }
I20260812 11:24:57.869419 16058 sys_catalog.cc:458] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:57.869419 16060 sys_catalog.cc:458] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:57.869834 16066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:24:57.872807 16066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:24:57.877458 16066 catalog_manager.cc:1347] Generated new cluster ID: 821bbfc23fb04305a706f3bfc131b23f
I20260812 11:24:57.877517 16066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:24:57.886909 16066 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:24:57.888033 16066 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:24:57.901183 16066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3: Generated new TSK 0
I20260812 11:24:57.901854 16066 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:24:57.930090 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39687
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:58.036949 16092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:58.037237 16092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:58.037292 16092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:58.041204 16092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:58.041251 16092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:58.041311 16092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:24:58.046341 16092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:58.047231 16092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:58.048174 16092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:58.057240 16099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:58.057286 16092 server_base.cc:1034] running on GCE node
W20260812 11:24:58.057329 16108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.057257 16102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:58.057801 16092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:58.058377 16092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:58.059525 16092 hybrid_clock.cc:648] HybridClock initialized: now 1786533898059505 us; error 29 us; skew 500 ppm
Aug 12 11:24:58 dist-test-slave-gjrz krb5kdc[15910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533898, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:58.065287 16092 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:24:58.066049 16092 webserver.cc:460] Webserver started at http://127.12.175.193:43421/ using document root <none> and password file <none>
I20260812 11:24:58.066519 16092 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:58.066573 16092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:58.066731 16092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:58.068656 16092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "e11fbe7cf994a68d77ea33eb50003cce"
server_key_iv: "65ee153a138eed7ef4286bd84723698a"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.069165 16092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "e11fbe7cf994a68d77ea33eb50003cce"
server_key_iv: "65ee153a138eed7ef4286bd84723698a"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.072685 16092 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:24:58.074824 16122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.075953 16092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:58.076057 16092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "e11fbe7cf994a68d77ea33eb50003cce"
server_key_iv: "65ee153a138eed7ef4286bd84723698a"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.076143 16092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:58.098466 16092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:58.101090 16092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:58.101248 16092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:58.101751 16092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:58.102511 16092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:58.102556 16092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.102605 16092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:58.102634 16092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.110610 16092 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:44657
I20260812 11:24:58.110641 16327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:44657 every 8 connection(s)
I20260812 11:24:58.111423 16092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:24:58.115492 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16092
I20260812 11:24:58.115605 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:24:58.115876 12991 external_mini_cluster.cc:1428] Setting key cb359456d3be8ca75dc019c17a2a16e4
Aug 12 11:24:58 dist-test-slave-gjrz krb5kdc[15910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533898, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:58.124747 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.112983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:33979 (local address 127.12.175.254:39687)
0812 11:24:58.113110 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.113114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.113878 (+ 764us) server_negotiation.cc:407] Connection header received
0812 11:24:58.115125 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.115129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.115184 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.115255 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:58.116459 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.117162 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.118668 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.118899 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.118972 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.121429 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:58.121432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:58.121434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:58.121459 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:58.122848 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.123337 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.123340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.123341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.123423 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.123736 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.123738 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.123740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.123913 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:58.123997 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.124459 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.124591 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:24:58.125403 16330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.113325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39687 (local address 127.12.175.193:33979)
0812 11:24:58.113736 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.113775 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.114921 (+ 1146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.115454 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.115461 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.115827 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:58.116328 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.116347 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.117294 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.117298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.118554 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.118567 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.119033 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.119037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.119224 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.119796 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:58.119811 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:58.121283 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:58.122954 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:58.122958 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:58.122969 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:58.123222 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:58.123507 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:58.123510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:58.123512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:58.123637 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:58.124010 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:58.124017 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:58.124234 (+ 217us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.124379 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.124668 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:24:58.126614 16328 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39687
I20260812 11:24:58.126804 16328 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:58.127213 16328 heartbeater.cc:511] Master 127.12.175.254:39687 requested a full tablet report, sending...
I20260812 11:24:58.128697 15990 ts_manager.cc:194] Registered new tserver with Master: bb4843ffe8124b71bb4db5d7f6f9f8d4 (127.12.175.193:44657)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
I20260812 11:24:58.129797 15990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:33979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:24:58.142449 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39687
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:58.247330 16334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:58.247547 16334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:58.247592 16334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:58.251436 16334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:58.251482 16334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:58.251559 16334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:24:58.256637 16334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:58.257467 16334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:58.258325 16334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:58.267068 16349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.267069 16348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.267097 16351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:58.267352 16334 server_base.cc:1034] running on GCE node
I20260812 11:24:58.267813 16334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:58.268329 16334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:58.269483 16334 hybrid_clock.cc:648] HybridClock initialized: now 1786533898269452 us; error 43 us; skew 500 ppm
Aug 12 11:24:58 dist-test-slave-gjrz krb5kdc[15910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533898, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:58.272012 16334 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:24:58.272760 16334 webserver.cc:460] Webserver started at http://127.12.175.194:34071/ using document root <none> and password file <none>
I20260812 11:24:58.273245 16334 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:58.273308 16334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:58.273475 16334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:58.275336 16334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "75ca9613389f447b83bfdacd1db07416"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "85b1396644260a270e7f3108031607c4"
server_key_iv: "3550ae0089afe77a0afe520f28e72909"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.275825 16334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "75ca9613389f447b83bfdacd1db07416"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "85b1396644260a270e7f3108031607c4"
server_key_iv: "3550ae0089afe77a0afe520f28e72909"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.279237 16334 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 11:24:58.281488 16366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.282574 16334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:58.282685 16334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "75ca9613389f447b83bfdacd1db07416"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "85b1396644260a270e7f3108031607c4"
server_key_iv: "3550ae0089afe77a0afe520f28e72909"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.282770 16334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:58.295184 16334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:58.297534 16334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:58.297686 16334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:58.298195 16334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:58.298911 16334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:58.298957 16334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.299005 16334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:58.299041 16334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.306972 16334 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:35979
I20260812 11:24:58.306996 16578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:35979 every 8 connection(s)
I20260812 11:24:58.307744 16334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
Aug 12 11:24:58 dist-test-slave-gjrz krb5kdc[15910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533898, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:58.317519 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16334
I20260812 11:24:58.317637 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:24:58.317904 12991 external_mini_cluster.cc:1428] Setting key af9b134c6e0c200d24551b22293c2dee
I20260812 11:24:58.319617 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.309272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:45791 (local address 127.12.175.254:39687)
0812 11:24:58.309435 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.309439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.310138 (+ 699us) server_negotiation.cc:407] Connection header received
0812 11:24:58.311334 (+ 1196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.311337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.311385 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.311453 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:58.312452 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.312965 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.313998 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.314255 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.314329 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.316465 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:58.316469 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:58.316471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:58.316494 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:58.317643 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.318118 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.318122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.318124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.318200 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.318557 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.318560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.318561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.318729 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:58.318813 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.319336 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.319450 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:24:58.320289 16582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.309596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39687 (local address 127.12.175.194:45791)
0812 11:24:58.309998 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.310038 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.311130 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.311599 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.311606 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.311910 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:58.312341 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.312355 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.313050 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.313052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.313903 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.313912 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.314366 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.314369 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.314499 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.314985 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:58.315000 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:58.316324 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:58.317752 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:58.317758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:58.317771 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:58.318017 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:58.318295 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:58.318298 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:58.318299 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:58.318451 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:58.318835 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:58.318841 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:58.319085 (+ 244us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.319294 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.319581 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":109,"threads_started":1}
I20260812 11:24:58.321291 16579 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39687
I20260812 11:24:58.321491 16579 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:58.321936 16579 heartbeater.cc:511] Master 127.12.175.254:39687 requested a full tablet report, sending...
I20260812 11:24:58.322865 15990 ts_manager.cc:194] Registered new tserver with Master: 75ca9613389f447b83bfdacd1db07416 (127.12.175.194:35979)
I20260812 11:24:58.323436 15990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:45791
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:24:58.343434 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39687
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:33833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:24:58.449891 16588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:58.450098 16588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:58.450135 16588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:58.454027 16588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:58.454083 16588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:58.454150 16588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:24:58.459084 16588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:33833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:39687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:58.459940 16588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:58.460790 16588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:58.469478 16599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.469475 16594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.469483 16595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:58.469785 16588 server_base.cc:1034] running on GCE node
I20260812 11:24:58.470142 16588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:58.470661 16588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:58.471798 16588 hybrid_clock.cc:648] HybridClock initialized: now 1786533898471773 us; error 36 us; skew 500 ppm
Aug 12 11:24:58 dist-test-slave-gjrz krb5kdc[15910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533898, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:24:58.474331 16588 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:24:58.475065 16588 webserver.cc:460] Webserver started at http://127.12.175.195:33897/ using document root <none> and password file <none>
I20260812 11:24:58.475584 16588 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:58.475651 16588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:58.475842 16588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:58.477715 16588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "c07d10592a7944b5a2e5c9486143506d"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "7c107c9718b1fa0d12459042acdc9f09"
server_key_iv: "32807220ce07ee22cb7f1ae30489bacb"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.478220 16588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "c07d10592a7944b5a2e5c9486143506d"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "7c107c9718b1fa0d12459042acdc9f09"
server_key_iv: "32807220ce07ee22cb7f1ae30489bacb"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.481956 16588 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:24:58.484126 16608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.485201 16588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:24:58.485301 16588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "c07d10592a7944b5a2e5c9486143506d"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "7c107c9718b1fa0d12459042acdc9f09"
server_key_iv: "32807220ce07ee22cb7f1ae30489bacb"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.485386 16588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:58.509707 16588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:58.512126 16588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:58.512275 16588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:58.512765 16588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:58.513485 16588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:58.513530 16588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.513579 16588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:58.513608 16588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.521423 16588 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:39325
I20260812 11:24:58.521476 16823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:39325 every 8 connection(s)
I20260812 11:24:58.522210 16588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:24:58.529022 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16588
I20260812 11:24:58.529147 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:24:58.529457 12991 external_mini_cluster.cc:1428] Setting key 563a56bd329bd027386fba6886f6b523
Aug 12 11:24:58 dist-test-slave-gjrz krb5kdc[15910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533898, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:24:58.533967 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.523772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:36981 (local address 127.12.175.254:39687)
0812 11:24:58.523925 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.523930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.524658 (+ 728us) server_negotiation.cc:407] Connection header received
0812 11:24:58.525844 (+ 1186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.525846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.525892 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.525960 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:58.526925 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.527486 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.528520 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.528723 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.528788 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.531152 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:58.531155 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:58.531157 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:58.531180 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:58.532463 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.532872 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.532875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.532876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.532944 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.533189 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.533191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.533192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.533343 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:58.533408 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.533771 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.533857 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:24:58.534637 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.524119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:39687 (local address 127.12.175.195:36981)
0812 11:24:58.524519 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.524559 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.525652 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.526103 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.526110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.526405 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:58.526818 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.526830 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.527577 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.527580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.528432 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.528441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.528837 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.528840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.528969 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.529482 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:24:58.529499 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:58.530982 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:58.532557 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:58.532561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:58.532571 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:58.532799 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:58.533002 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:24:58.533004 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:24:58.533006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:24:58.533129 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:24:58.533408 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:58.533412 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:58.533605 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.533741 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.533953 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":114,"threads_started":1}
I20260812 11:24:58.535624 16828 heartbeater.cc:347] Connected to a master server at 127.12.175.254:39687
I20260812 11:24:58.535840 16828 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:58.536257 16828 heartbeater.cc:511] Master 127.12.175.254:39687 requested a full tablet report, sending...
I20260812 11:24:58.537153 15990 ts_manager.cc:194] Registered new tserver with Master: c07d10592a7944b5a2e5c9486143506d (127.12.175.195:39325)
I20260812 11:24:58.537670 15990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:36981
I20260812 11:24:58.542788 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:24:58.550933 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.544569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42978 (local address 127.12.175.254:39687)
0812 11:24:58.544691 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.544695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.544837 (+ 142us) server_negotiation.cc:407] Connection header received
0812 11:24:58.544925 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.544927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.544958 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.545015 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:58.545588 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.546033 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.546806 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.547073 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.547158 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.548444 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:58.548447 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:58.548449 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:24:58.548470 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:58.549653 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.550034 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.550036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.550038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.550102 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:24:58.550314 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:24:58.550316 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:24:58.550317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:24:58.550476 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:58.550587 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.550731 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.550795 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:24:58.553344 15990 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:24:58.556156 15990 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:24:58.569023 16851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.563761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.12.175.194:35979)
0812 11:24:58.564725 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.564736 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.564760 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:24:58.564834 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.564839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.565043 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.565294 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:58.565531 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.566238 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.567727 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.568409 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.568519 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.568659 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.568807 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.568897 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":861,"thread_start_us":113,"threads_started":1}
I20260812 11:24:58.569024 16847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.563599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:35979 (local address 127.0.0.1:51142)
0812 11:24:58.564217 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.564262 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.564381 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.565196 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.565199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.565228 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:58.565419 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.565427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.566357 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.566360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.567590 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.567602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.568518 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.568522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.568639 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.568675 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.568770 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.568882 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":43,"spinlock_wait_cycles":2688,"thread_start_us":92,"threads_started":1}
I20260812 11:24:58.569263 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.563890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44657 (local address 127.0.0.1:43878)
0812 11:24:58.564412 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.564423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.564493 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.565121 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.565127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.565148 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:58.565269 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.565276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.566791 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.566794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.567761 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.567771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.568896 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.568900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.568983 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.569004 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.569052 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.569116 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":86,"threads_started":1}
I20260812 11:24:58.569569 16857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.564047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59384 (local address 127.12.175.195:39325)
0812 11:24:58.564649 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.564661 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.564683 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:24:58.564747 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.564753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.564933 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.565076 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:58.565466 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.566609 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.568022 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.568798 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.568897 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.569013 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.569352 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.569445 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":139,"threads_started":1}
I20260812 11:24:58.569864 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.564298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43878 (local address 127.12.175.193:44657)
0812 11:24:58.564701 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.564712 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.564729 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:24:58.564789 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.564793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.564933 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.565421 (+ 488us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:58.565573 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.566643 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.567889 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.568759 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.569474 (+ 715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.569601 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.569649 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.569734 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":93,"threads_started":1}
I20260812 11:24:58.569864 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.563439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:39325 (local address 127.0.0.1:59384)
0812 11:24:58.564333 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.564347 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.564435 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.565196 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.565199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.565228 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:58.565354 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.565361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.566752 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.566756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.567908 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.567917 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.569084 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.569087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.569180 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.569200 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.569264 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.569755 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":57,"spinlock_wait_cycles":7808,"thread_start_us":84,"threads_started":1}
I20260812 11:24:58.572384 16698 tablet_service.cc:1467] Processing CreateTablet for tablet fca88617911f4682a6b3f6e81392ba28 (DEFAULT_TABLE table=test-table [id=6c715c5064484c2191540d7e1e87367e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:58.572343 16454 tablet_service.cc:1467] Processing CreateTablet for tablet fca88617911f4682a6b3f6e81392ba28 (DEFAULT_TABLE table=test-table [id=6c715c5064484c2191540d7e1e87367e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:58.572719 16212 tablet_service.cc:1467] Processing CreateTablet for tablet fca88617911f4682a6b3f6e81392ba28 (DEFAULT_TABLE table=test-table [id=6c715c5064484c2191540d7e1e87367e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:58.573264 16698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca88617911f4682a6b3f6e81392ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:58.573333 16454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca88617911f4682a6b3f6e81392ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:58.573580 16212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca88617911f4682a6b3f6e81392ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:58.578866 16861 tablet_bootstrap.cc:492] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Bootstrap starting.
I20260812 11:24:58.580482 16863 tablet_bootstrap.cc:492] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: Bootstrap starting.
I20260812 11:24:58.580807 16865 tablet_bootstrap.cc:492] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Bootstrap starting.
I20260812 11:24:58.581200 16861 tablet_bootstrap.cc:654] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:58.582406 16861 log.cc:824] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:58.582544 16865 tablet_bootstrap.cc:654] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:58.583601 16865 log.cc:824] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:58.584084 16861 tablet_bootstrap.cc:492] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: No bootstrap required, opened a new log
I20260812 11:24:58.584276 16861 ts_tablet_manager.cc:1397] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:24:58.585204 16863 tablet_bootstrap.cc:654] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:58.585489 16865 tablet_bootstrap.cc:492] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: No bootstrap required, opened a new log
I20260812 11:24:58.585680 16865 ts_tablet_manager.cc:1397] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:24:58.586499 16863 log.cc:824] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:58.587435 16861 raft_consensus.cc:348] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.587682 16861 raft_consensus.cc:374] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:58.587764 16861 raft_consensus.cc:729] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d10592a7944b5a2e5c9486143506d, State: Initialized, Role: FOLLOWER
I20260812 11:24:58.588255 16861 consensus_queue.cc:260] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.588469 16863 tablet_bootstrap.cc:492] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: No bootstrap required, opened a new log
I20260812 11:24:58.588654 16863 ts_tablet_manager.cc:1397] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 11:24:58.589012 16865 raft_consensus.cc:348] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.589221 16861 ts_tablet_manager.cc:1428] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:24:58.589277 16865 raft_consensus.cc:374] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:58.589339 16865 raft_consensus.cc:729] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ca9613389f447b83bfdacd1db07416, State: Initialized, Role: FOLLOWER
I20260812 11:24:58.589587 16828 heartbeater.cc:503] Master 127.12.175.254:39687 was elected leader, sending a full tablet report...
I20260812 11:24:58.589769 16865 consensus_queue.cc:260] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.590373 16579 heartbeater.cc:503] Master 127.12.175.254:39687 was elected leader, sending a full tablet report...
I20260812 11:24:58.591580 16865 ts_tablet_manager.cc:1428] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:24:58.591894 16863 raft_consensus.cc:348] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.592135 16863 raft_consensus.cc:374] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:58.592195 16863 raft_consensus.cc:729] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4843ffe8124b71bb4db5d7f6f9f8d4, State: Initialized, Role: FOLLOWER
I20260812 11:24:58.592598 16863 consensus_queue.cc:260] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.593403 16328 heartbeater.cc:503] Master 127.12.175.254:39687 was elected leader, sending a full tablet report...
I20260812 11:24:58.593475 16863 ts_tablet_manager.cc:1428] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
W20260812 11:24:58.612376 16329 tablet.cc:2369] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:58.707248 16876 raft_consensus.cc:482] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:58.707464 16876 raft_consensus.cc:504] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.708547 16876 leader_election.cc:288] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07d10592a7944b5a2e5c9486143506d (127.12.175.195:39325), bb4843ffe8124b71bb4db5d7f6f9f8d4 (127.12.175.193:44657)
I20260812 11:24:58.712177 16582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.708767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44657 (local address 127.12.175.194:49295)
0812 11:24:58.708865 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.708879 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.708963 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.709220 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.709223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.709242 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:58.709357 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.709365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.710195 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.710199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.711089 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.711099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.711785 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.711789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.711890 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.711918 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.711986 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.712057 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":23}
I20260812 11:24:58.712210 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.708859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:49295 (local address 127.12.175.193:44657)
0812 11:24:58.708974 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.708979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.708995 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:24:58.709060 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.709063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.709117 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.709203 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:58.709470 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.710086 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.711214 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.711676 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.711767 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.711808 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.712007 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.712089 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:24:58.712327 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.708767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:39325 (local address 127.12.175.194:39965)
0812 11:24:58.709226 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.709240 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:58.709333 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:58.709560 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:58.709563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:58.709579 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:58.709703 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.709710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.710456 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.710458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.711291 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:58.711301 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.711947 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.711950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:58.712045 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.712068 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:24:58.712140 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:24:58.712202 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":104,"thread_start_us":145,"threads_started":1}
I20260812 11:24:58.712340 16857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.708859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:39965 (local address 127.12.175.195:39325)
0812 11:24:58.708974 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.708979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.709324 (+ 345us) server_negotiation.cc:407] Connection header received
0812 11:24:58.709411 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.709414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.709467 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.709526 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:58.709806 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.710350 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.711407 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.711836 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.711945 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.711993 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.712166 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.712234 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:24:58.712883 16742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca88617911f4682a6b3f6e81392ba28" candidate_uuid: "75ca9613389f447b83bfdacd1db07416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d10592a7944b5a2e5c9486143506d" is_pre_election: true
I20260812 11:24:58.713002 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca88617911f4682a6b3f6e81392ba28" candidate_uuid: "75ca9613389f447b83bfdacd1db07416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" is_pre_election: true
I20260812 11:24:58.713141 16742 raft_consensus.cc:2454] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ca9613389f447b83bfdacd1db07416 in term 0.
I20260812 11:24:58.713279 16252 raft_consensus.cc:2454] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ca9613389f447b83bfdacd1db07416 in term 0.
I20260812 11:24:58.713603 16367 leader_election.cc:302] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ca9613389f447b83bfdacd1db07416, c07d10592a7944b5a2e5c9486143506d; no voters:
I20260812 11:24:58.713843 16876 raft_consensus.cc:2781] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:24:58.713919 16876 raft_consensus.cc:482] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:24:58.713950 16876 raft_consensus.cc:3037] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:58.714919 16876 raft_consensus.cc:504] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.715229 16876 leader_election.cc:288] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [CANDIDATE]: Term 1 election: Requested vote from peers c07d10592a7944b5a2e5c9486143506d (127.12.175.195:39325), bb4843ffe8124b71bb4db5d7f6f9f8d4 (127.12.175.193:44657)
I20260812 11:24:58.715515 16742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca88617911f4682a6b3f6e81392ba28" candidate_uuid: "75ca9613389f447b83bfdacd1db07416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d10592a7944b5a2e5c9486143506d"
I20260812 11:24:58.715615 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca88617911f4682a6b3f6e81392ba28" candidate_uuid: "75ca9613389f447b83bfdacd1db07416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4"
I20260812 11:24:58.715633 16742 raft_consensus.cc:3037] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:58.715720 16252 raft_consensus.cc:3037] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:58.716609 16742 raft_consensus.cc:2454] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ca9613389f447b83bfdacd1db07416 in term 1.
I20260812 11:24:58.716661 16252 raft_consensus.cc:2454] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ca9613389f447b83bfdacd1db07416 in term 1.
I20260812 11:24:58.716872 16367 leader_election.cc:302] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ca9613389f447b83bfdacd1db07416, c07d10592a7944b5a2e5c9486143506d; no voters:
I20260812 11:24:58.717026 16876 raft_consensus.cc:2781] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:58.717223 16876 raft_consensus.cc:686] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 1 LEADER]: Becoming Leader. State: Replica: 75ca9613389f447b83bfdacd1db07416, State: Running, Role: LEADER
I20260812 11:24:58.717499 16876 consensus_queue.cc:237] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } }
I20260812 11:24:58.720395 15988 catalog_manager.cc:5495] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75ca9613389f447b83bfdacd1db07416 (127.12.175.194). New cstate: current_term: 1 leader_uuid: "75ca9613389f447b83bfdacd1db07416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75ca9613389f447b83bfdacd1db07416" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 35979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 } health_report { overall_health: UNKNOWN } } }
I20260812 11:24:58.763602 16851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.760507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51156 (local address 127.12.175.194:35979)
0812 11:24:58.760639 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:58.760642 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:58.760656 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:24:58.760722 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:58.760724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:58.760775 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:58.760858 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:24:58.761046 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.761523 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.762310 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:58.762523 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:58.762599 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:58.762806 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:24:58.763180 (+ 374us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:24:58.763308 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:58.763401 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 11:24:58.763438 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:24:58.769200 16252 raft_consensus.cc:1261] T fca88617911f4682a6b3f6e81392ba28 P bb4843ffe8124b71bb4db5d7f6f9f8d4 [term 1 FOLLOWER]: Refusing update from remote peer 75ca9613389f447b83bfdacd1db07416: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:58.769223 16742 raft_consensus.cc:1261] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 1 FOLLOWER]: Refusing update from remote peer 75ca9613389f447b83bfdacd1db07416: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:58.769878 16876 consensus_queue.cc:1035] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4843ffe8124b71bb4db5d7f6f9f8d4" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 44657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:58.770062 16884 consensus_queue.cc:1035] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d10592a7944b5a2e5c9486143506d" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:24:58.773025 16829 tablet.cc:2369] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:58.785322 15989 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:58.785449 15989 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:58.787613 15989 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d44b585579324deda4b34111863c86b3: Sending DeleteTablet for 3 replicas of tablet fca88617911f4682a6b3f6e81392ba28
I20260812 11:24:58.788295 16454 tablet_service.cc:1514] Processing DeleteTablet for tablet fca88617911f4682a6b3f6e81392ba28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:58 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:51142
I20260812 11:24:58.788367 16698 tablet_service.cc:1514] Processing DeleteTablet for tablet fca88617911f4682a6b3f6e81392ba28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:58 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:59384
I20260812 11:24:58.788821 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16092
I20260812 11:24:58.789077 16911 tablet_replica.cc:330] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: stopping tablet replica
I20260812 11:24:58.789316 16911 raft_consensus.cc:2229] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:24:58.789575 16912 tablet_replica.cc:330] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: stopping tablet replica
I20260812 11:24:58.789644 16911 raft_consensus.cc:2258] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:58.792518 16912 raft_consensus.cc:2229] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:58.792840 16912 raft_consensus.cc:2258] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:58.795750 16912 ts_tablet_manager.cc:1905] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:58.798410 16912 ts_tablet_manager.cc:1918] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:58.798502 16912 log.cc:1196] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/fca88617911f4682a6b3f6e81392ba28
I20260812 11:24:58.798864 16912 ts_tablet_manager.cc:1939] T fca88617911f4682a6b3f6e81392ba28 P c07d10592a7944b5a2e5c9486143506d: Deleting consensus metadata
I20260812 11:24:58.800019 15962 catalog_manager.cc:4841] TS c07d10592a7944b5a2e5c9486143506d (127.12.175.195:39325): tablet fca88617911f4682a6b3f6e81392ba28 (table test-table [id=6c715c5064484c2191540d7e1e87367e]) successfully deleted
I20260812 11:24:58.800663 16911 ts_tablet_manager.cc:1905] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:24:58.803337 15968 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:44657 (error 108)
I20260812 11:24:58.803426 16911 ts_tablet_manager.cc:1918] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:58.803529 16911 log.cc:1196] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/fca88617911f4682a6b3f6e81392ba28
I20260812 11:24:58.803810 16911 ts_tablet_manager.cc:1939] T fca88617911f4682a6b3f6e81392ba28 P 75ca9613389f447b83bfdacd1db07416: Deleting consensus metadata
I20260812 11:24:58.804208 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.803962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:44657 (local address 127.0.0.1:43892)
0812 11:24:58.804072 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.804134 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:44657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 11:24:58.804344 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16334
W20260812 11:24:58.807446 15968 catalog_manager.cc:4584] TS bb4843ffe8124b71bb4db5d7f6f9f8d4 (127.12.175.193:44657): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fca88617911f4682a6b3f6e81392ba28: Network error: Client connection negotiation failed: client connection to 127.12.175.193:44657: connect: Connection refused (error 111)
I20260812 11:24:58.814337 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16588
I20260812 11:24:58.814649 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:58.814400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:35979 (local address 127.0.0.1:51162)
0812 11:24:58.814544 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:58.814586 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.194:35979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 11:24:58.827494 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 15936
2026-08-12T11:24:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2473 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T11:24:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:24:58Z Disabled control of system clock
I20260812 11:24:58.860083 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36513
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:36513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:24:58.965196 16921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:58.965411 16921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:58.965447 16921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:58.969332 16921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:24:58.969379 16921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:58.969394 16921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:58.969424 16921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:24:58.969449 16921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:24:58.973958 16921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:36513
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:58.974828 16921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:58.976084 16921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:58.983804 16933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.983855 16930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:58.983821 16929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:58.984112 16921 server_base.cc:1034] running on GCE node
I20260812 11:24:58.984614 16921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:58.985574 16921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:58.986744 16921 hybrid_clock.cc:648] HybridClock initialized: now 1786533898986724 us; error 30 us; skew 500 ppm
I20260812 11:24:58.988417 16921 webserver.cc:460] Webserver started at http://127.12.175.254:39417/ using document root <none> and password file <none>
I20260812 11:24:58.988916 16921 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:58.988981 16921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:58.989166 16921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:58.990994 16921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "a0432c10acdc47caba9880e52be1504e"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "2290c727898b4b9779831a1b1abad1f6"
server_key_iv: "da477b503f912dd187dd358a9c72ac0f"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.991537 16921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "a0432c10acdc47caba9880e52be1504e"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "2290c727898b4b9779831a1b1abad1f6"
server_key_iv: "da477b503f912dd187dd358a9c72ac0f"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.994844 16921 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:24:58.997004 16942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:58.998054 16921 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:24:58.998159 16921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "a0432c10acdc47caba9880e52be1504e"
format_stamp: "Formatted at 2026-08-12 11:24:58 on dist-test-slave-gjrz"
server_key: "2290c727898b4b9779831a1b1abad1f6"
server_key_iv: "da477b503f912dd187dd358a9c72ac0f"
server_key_version: "encryptionkey@0"
I20260812 11:24:58.998245 16921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:59.014509 16921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:59.015053 16921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:59.015202 16921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:59.021235 16921 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:36513
I20260812 11:24:59.021262 17034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:36513 every 8 connection(s)
I20260812 11:24:59.022042 16921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:24:59.024667 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 16921
I20260812 11:24:59.024787 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:24:59.024950 17035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:59.025092 12991 external_mini_cluster.cc:1428] Setting key 08baed0da3a161bd53a930313090fbdc
I20260812 11:24:59.031677 17035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e: Bootstrap starting.
I20260812 11:24:59.034170 17035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:59.034994 17035 log.cc:824] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:59.035109 17045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.026352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48184 (local address 127.12.175.254:36513)
0812 11:24:59.026993 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.027010 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.027053 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:24:59.028082 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.028108 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.028599 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.028947 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:59.029382 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.030836 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.031726 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.032373 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.032540 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.033260 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:59.033267 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:59.033282 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:59.033730 (+ 448us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:59.033796 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:59.033821 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:59.033910 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.033995 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.034246 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":124,"threads_started":1}
I20260812 11:24:59.036775 17035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e: No bootstrap required, opened a new log
I20260812 11:24:59.040223 17035 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0432c10acdc47caba9880e52be1504e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36513 } }
I20260812 11:24:59.040417 17035 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:59.040469 17035 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0432c10acdc47caba9880e52be1504e, State: Initialized, Role: FOLLOWER
I20260812 11:24:59.040876 17035 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0432c10acdc47caba9880e52be1504e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36513 } }
I20260812 11:24:59.041009 17035 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:24:59.041072 17035 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:24:59.041160 17035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:59.041945 17035 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0432c10acdc47caba9880e52be1504e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36513 } }
I20260812 11:24:59.042246 17035 leader_election.cc:302] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0432c10acdc47caba9880e52be1504e; no voters:
I20260812 11:24:59.042505 17035 leader_election.cc:288] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:24:59.042627 17052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:59.042811 17052 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [term 1 LEADER]: Becoming Leader. State: Replica: a0432c10acdc47caba9880e52be1504e, State: Running, Role: LEADER
I20260812 11:24:59.043141 17052 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0432c10acdc47caba9880e52be1504e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36513 } }
I20260812 11:24:59.043568 17035 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:24:59.044765 17053 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0432c10acdc47caba9880e52be1504e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0432c10acdc47caba9880e52be1504e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36513 } } }
I20260812 11:24:59.044780 17055 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0432c10acdc47caba9880e52be1504e. Latest consensus state: current_term: 1 leader_uuid: "a0432c10acdc47caba9880e52be1504e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0432c10acdc47caba9880e52be1504e" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36513 } } }
I20260812 11:24:59.044886 17053 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:59.044898 17055 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e [sys.catalog]: This master's current role is: LEADER
I20260812 11:24:59.045945 17066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:24:59.048573 17066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:24:59.053580 17066 catalog_manager.cc:1347] Generated new cluster ID: 0d8859fcc3ac4929bf6e861316d233cb
I20260812 11:24:59.053642 17066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:24:59.070397 17066 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:24:59.071569 17066 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:24:59.087584 17066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e: Generated new TSK 0
I20260812 11:24:59.088356 17066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:24:59.092823 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36513
--builtin_ntp_servers=127.12.175.212:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:24:59.200269 17079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:59.200498 17079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:59.200549 17079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:59.204536 17079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:59.204587 17079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:59.204658 17079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:24:59.209125 17079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:59.210034 17079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:59.211278 17079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:59.219992 17090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:59.219973 17089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:59.220114 17079 server_base.cc:1034] running on GCE node
W20260812 11:24:59.219959 17092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:59.220595 17079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:59.221149 17079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:59.222302 17079 hybrid_clock.cc:648] HybridClock initialized: now 1786533899222286 us; error 27 us; skew 500 ppm
I20260812 11:24:59.223974 17079 webserver.cc:460] Webserver started at http://127.12.175.193:38689/ using document root <none> and password file <none>
I20260812 11:24:59.224480 17079 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:59.224551 17079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:59.224743 17079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:59.226578 17079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "8abdc336bb7944a785d7088a20006880"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "1f87990f9af05260b3778284fa2d1787"
server_key_iv: "c1e721ce77b9c209c7cb6253f0bfea3d"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.227082 17079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "8abdc336bb7944a785d7088a20006880"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "1f87990f9af05260b3778284fa2d1787"
server_key_iv: "c1e721ce77b9c209c7cb6253f0bfea3d"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.230443 17079 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:24:59.232642 17101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.233711 17079 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:24:59.233810 17079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "8abdc336bb7944a785d7088a20006880"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "1f87990f9af05260b3778284fa2d1787"
server_key_iv: "c1e721ce77b9c209c7cb6253f0bfea3d"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.233894 17079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:59.251021 17079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:59.251611 17079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:59.251760 17079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:59.252255 17079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:59.253093 17079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:59.253139 17079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.253187 17079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:59.253214 17079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.260821 17079 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:37503
I20260812 11:24:59.260847 17292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:37503 every 8 connection(s)
I20260812 11:24:59.261607 17079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:24:59.269373 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17079
I20260812 11:24:59.269492 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:24:59.269820 12991 external_mini_cluster.cc:1428] Setting key 35adb325b0da784a995da8aed0073dad
I20260812 11:24:59.270090 17045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.263217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:46235 (local address 127.12.175.254:36513)
0812 11:24:59.263358 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.263362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.264324 (+ 962us) server_negotiation.cc:407] Connection header received
0812 11:24:59.265663 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.265667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.265723 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.265793 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:59.266641 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.267167 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.268294 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.268513 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.268613 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.269619 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:59.269622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:59.269624 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:59.269637 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:59.269657 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:59.269665 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:59.269727 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.269884 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.269948 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:24:59.270869 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.263584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:36513 (local address 127.12.175.193:46235)
0812 11:24:59.264191 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.264228 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.265442 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.265964 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.265971 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.266050 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:59.266497 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.266509 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.267323 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.267325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.268176 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.268186 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.268658 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.268662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.268814 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.269330 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:24:59.269332 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:59.269382 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:24:59.269459 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:59.269746 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:59.269755 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:59.269761 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.269888 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.270169 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":106,"threads_started":1}
I20260812 11:24:59.271703 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36513
--builtin_ntp_servers=127.12.175.212:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:24:59.271987 17295 heartbeater.cc:347] Connected to a master server at 127.12.175.254:36513
I20260812 11:24:59.272197 17295 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:59.272644 17295 heartbeater.cc:511] Master 127.12.175.254:36513 requested a full tablet report, sending...
I20260812 11:24:59.273991 16971 ts_manager.cc:194] Registered new tserver with Master: 8abdc336bb7944a785d7088a20006880 (127.12.175.193:37503)
I20260812 11:24:59.275087 16971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.193:46235
W20260812 11:24:59.377394 17302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:59.377605 17302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:59.377655 17302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:59.381541 17302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:59.381587 17302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:59.381659 17302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:24:59.386121 17302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:59.386955 17302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:59.388163 17302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:59.396468 17309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:59.396481 17311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:59.396512 17302 server_base.cc:1034] running on GCE node
W20260812 11:24:59.396481 17313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:59.397089 17302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:59.397615 17302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:59.398769 17302 hybrid_clock.cc:648] HybridClock initialized: now 1786533899398753 us; error 32 us; skew 500 ppm
I20260812 11:24:59.400421 17302 webserver.cc:460] Webserver started at http://127.12.175.194:42139/ using document root <none> and password file <none>
I20260812 11:24:59.400899 17302 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:59.400961 17302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:59.401160 17302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:59.402976 17302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "cdf0516c07664a1b9faf5d89b0737175"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "a4dfe4aef2be6398b8b725f0bb68f933"
server_key_iv: "11875d6086292172e0b0eaf62bb667ff"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.403498 17302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "cdf0516c07664a1b9faf5d89b0737175"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "a4dfe4aef2be6398b8b725f0bb68f933"
server_key_iv: "11875d6086292172e0b0eaf62bb667ff"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.406679 17302 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:24:59.408819 17324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.409839 17302 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:24:59.409938 17302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "cdf0516c07664a1b9faf5d89b0737175"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "a4dfe4aef2be6398b8b725f0bb68f933"
server_key_iv: "11875d6086292172e0b0eaf62bb667ff"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.410022 17302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:59.434449 17302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:59.434991 17302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:59.435144 17302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:59.435680 17302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:59.436532 17302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:59.436580 17302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.436630 17302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:59.436654 17302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.444687 17302 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:46163
I20260812 11:24:59.444712 17526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:46163 every 8 connection(s)
I20260812 11:24:59.445488 17302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:24:59.448848 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17302
I20260812 11:24:59.448944 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:24:59.449219 12991 external_mini_cluster.cc:1428] Setting key 8ef5ce84d89449b2929d0fda9142d319
I20260812 11:24:59.451112 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36513
--builtin_ntp_servers=127.12.175.212:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:24:59.454600 17045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.447118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:46285 (local address 127.12.175.254:36513)
0812 11:24:59.447247 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.447251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.448294 (+ 1043us) server_negotiation.cc:407] Connection header received
0812 11:24:59.449718 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.449722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.449777 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.449855 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:59.450883 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.451462 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.452836 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.453050 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.453141 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.454135 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:59.454139 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:59.454142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:59.454156 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:59.454179 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:59.454189 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:59.454254 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.454398 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.454455 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:24:59.455366 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.447494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:36513 (local address 127.12.175.194:46285)
0812 11:24:59.448106 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.448143 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.449485 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.450018 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.450027 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.450143 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:59.450741 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.450759 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.451582 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.451585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.452715 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.452727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.453188 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.453192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.453359 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.453893 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:24:59.453894 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:59.453930 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:24:59.453988 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:59.454263 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:59.454271 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:59.454276 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.454379 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.454587 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":109,"threads_started":1}
I20260812 11:24:59.456353 17528 heartbeater.cc:347] Connected to a master server at 127.12.175.254:36513
I20260812 11:24:59.456558 17528 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:59.456998 17528 heartbeater.cc:511] Master 127.12.175.254:36513 requested a full tablet report, sending...
I20260812 11:24:59.457908 16971 ts_manager.cc:194] Registered new tserver with Master: cdf0516c07664a1b9faf5d89b0737175 (127.12.175.194:46163)
I20260812 11:24:59.458436 16971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.194:46285
W20260812 11:24:59.560667 17534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:24:59.560889 17534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:24:59.560938 17534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:24:59.564975 17534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:24:59.565025 17534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:24:59.565095 17534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:24:59.569670 17534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:36513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:24:59.570552 17534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:24:59.571827 17534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:24:59.580788 17545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:59.580780 17544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:24:59.580776 17547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:24:59.581162 17534 server_base.cc:1034] running on GCE node
I20260812 11:24:59.581496 17534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:24:59.582110 17534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:24:59.583278 17534 hybrid_clock.cc:648] HybridClock initialized: now 1786533899583239 us; error 35 us; skew 500 ppm
I20260812 11:24:59.584856 17534 webserver.cc:460] Webserver started at http://127.12.175.195:42377/ using document root <none> and password file <none>
I20260812 11:24:59.585342 17534 fs_manager.cc:359] Metadata directory not provided
I20260812 11:24:59.585397 17534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:24:59.585553 17534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:24:59.587505 17534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "3ab4310e0e0e45ae885727e7456649c5"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "85d61685ca7f7c5c77117c848b77eafc"
server_key_iv: "0823aad279234478d68c7f55f85fe26c"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.588088 17534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "3ab4310e0e0e45ae885727e7456649c5"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "85d61685ca7f7c5c77117c848b77eafc"
server_key_iv: "0823aad279234478d68c7f55f85fe26c"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.591514 17534 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:24:59.593748 17555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.594812 17534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:24:59.594914 17534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "3ab4310e0e0e45ae885727e7456649c5"
format_stamp: "Formatted at 2026-08-12 11:24:59 on dist-test-slave-gjrz"
server_key: "85d61685ca7f7c5c77117c848b77eafc"
server_key_iv: "0823aad279234478d68c7f55f85fe26c"
server_key_version: "encryptionkey@0"
I20260812 11:24:59.595000 17534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:24:59.611874 17534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:24:59.612412 17534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:24:59.612576 17534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:24:59.613059 17534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:24:59.613926 17534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:24:59.613971 17534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.614004 17534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:24:59.614032 17534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:24:59.621902 17534 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:46437
I20260812 11:24:59.621982 17788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:46437 every 8 connection(s)
I20260812 11:24:59.622685 17534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:24:59.627908 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17534
I20260812 11:24:59.628018 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:24:59.628300 12991 external_mini_cluster.cc:1428] Setting key affc3cafe05556765d3b56aea15dc0d6
I20260812 11:24:59.631542 17045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.624340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:60781 (local address 127.12.175.254:36513)
0812 11:24:59.624485 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.624489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.625465 (+ 976us) server_negotiation.cc:407] Connection header received
0812 11:24:59.626725 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.626727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.626772 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.626840 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:59.627719 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.628471 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.629796 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.630030 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.630119 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.631134 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:59.631137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:59.631139 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:59.631150 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:59.631169 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:59.631177 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:59.631232 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.631375 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.631434 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:24:59.632249 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.624688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:36513 (local address 127.12.175.195:60781)
0812 11:24:59.625328 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.625366 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.626556 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.627002 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.627009 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.627087 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:24:59.627587 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.627600 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.628617 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.628622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.629683 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.629693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.630185 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.630189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.630377 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.630898 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:24:59.630900 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:24:59.630938 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:24:59.630997 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:24:59.631240 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:24:59.631245 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:24:59.631248 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.631366 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.631569 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":114,"threads_started":1}
I20260812 11:24:59.633174 17790 heartbeater.cc:347] Connected to a master server at 127.12.175.254:36513
I20260812 11:24:59.633356 17790 heartbeater.cc:464] Registering TS with master...
I20260812 11:24:59.633787 17790 heartbeater.cc:511] Master 127.12.175.254:36513 requested a full tablet report, sending...
I20260812 11:24:59.634819 16971 ts_manager.cc:194] Registered new tserver with Master: 3ab4310e0e0e45ae885727e7456649c5 (127.12.175.195:46437)
I20260812 11:24:59.635403 16971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.195:60781
I20260812 11:24:59.641671 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:24:59.647106 17045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.643427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48196 (local address 127.12.175.254:36513)
0812 11:24:59.643571 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.643575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.643769 (+ 194us) server_negotiation.cc:407] Connection header received
0812 11:24:59.643919 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.643922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.643959 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.644016 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:24:59.644284 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.644760 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.645665 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.645872 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.645953 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.646654 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:24:59.646658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:24:59.646661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:24:59.646671 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:24:59.646692 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:24:59.646699 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:24:59.646797 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.646951 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.646985 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:24:59.649389 16971 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:24:59.652146 16971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:24:59.664788 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.659453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:46437 (local address 127.0.0.1:48416)
0812 11:24:59.660114 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.660128 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.660213 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.660892 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.660898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.660956 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:59.661071 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.661077 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.662182 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.662185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.663333 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.663344 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.664284 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.664287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.664397 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.664435 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.664537 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.664649 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":3,"spinlock_wait_cycles":896,"thread_start_us":109,"threads_started":1}
I20260812 11:24:59.664791 17820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.659761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48416 (local address 127.12.175.195:46437)
0812 11:24:59.660502 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.660512 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.660530 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:24:59.660581 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.660584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.660716 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.661197 (+ 481us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:59.661288 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.662082 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.663471 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.664181 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.664284 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.664462 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.664572 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.664657 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":119,"threads_started":1}
I20260812 11:24:59.665541 17817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.659315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:46163 (local address 127.0.0.1:46382)
0812 11:24:59.659941 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.659985 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.660103 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.661199 (+ 1096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.661202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.661218 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:59.661309 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.661315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.662737 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.662740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.663907 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.663928 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.665057 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.665060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.665191 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.665227 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.665288 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.665420 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":98,"thread_start_us":60,"threads_started":1}
I20260812 11:24:59.665624 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.660122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45776 (local address 127.12.175.193:37503)
0812 11:24:59.660481 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.660494 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.661032 (+ 538us) server_negotiation.cc:407] Connection header received
0812 11:24:59.661121 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.661126 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.661295 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.661432 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:59.661631 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.662717 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.663923 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.664697 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.664826 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.664990 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.665390 (+ 400us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.665472 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":119,"threads_started":1}
I20260812 11:24:59.665627 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.659464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46382 (local address 127.12.175.194:46163)
0812 11:24:59.660592 (+ 1128us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.660611 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.660636 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:24:59.660712 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.660717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.660911 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.661056 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:59.661458 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.662621 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.664032 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.664736 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.664838 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.664990 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.665369 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.665465 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":117,"threads_started":1}
I20260812 11:24:59.665872 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.659959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37503 (local address 127.0.0.1:45776)
0812 11:24:59.660846 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.660858 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.660941 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.661431 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.661434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.661452 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:59.661525 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.661531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.662814 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.662817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.663815 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.663824 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.665060 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.665063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.665186 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.665221 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.665288 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.665697 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":341,"thread_start_us":80,"threads_started":1}
I20260812 11:24:59.668023 17657 tablet_service.cc:1467] Processing CreateTablet for tablet 72a57a539cb345a2a1cec50278db7e6e (DEFAULT_TABLE table=test-table [id=fca09e9a5d9f4432ac82af517f0cb934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:59.668234 17403 tablet_service.cc:1467] Processing CreateTablet for tablet 72a57a539cb345a2a1cec50278db7e6e (DEFAULT_TABLE table=test-table [id=fca09e9a5d9f4432ac82af517f0cb934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:59.669054 17403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72a57a539cb345a2a1cec50278db7e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:59.669077 17657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72a57a539cb345a2a1cec50278db7e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:59.669075 17183 tablet_service.cc:1467] Processing CreateTablet for tablet 72a57a539cb345a2a1cec50278db7e6e (DEFAULT_TABLE table=test-table [id=fca09e9a5d9f4432ac82af517f0cb934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:24:59.669945 17183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72a57a539cb345a2a1cec50278db7e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:24:59.675791 17827 tablet_bootstrap.cc:492] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Bootstrap starting.
I20260812 11:24:59.674721 17825 tablet_bootstrap.cc:492] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Bootstrap starting.
I20260812 11:24:59.678100 17827 tablet_bootstrap.cc:654] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:59.678100 17825 tablet_bootstrap.cc:654] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:59.678941 17825 log.cc:824] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:59.678943 17827 log.cc:824] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:59.679562 17828 tablet_bootstrap.cc:492] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: Bootstrap starting.
I20260812 11:24:59.680711 17827 tablet_bootstrap.cc:492] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: No bootstrap required, opened a new log
I20260812 11:24:59.680888 17827 ts_tablet_manager.cc:1397] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 11:24:59.681236 17825 tablet_bootstrap.cc:492] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: No bootstrap required, opened a new log
I20260812 11:24:59.681399 17825 ts_tablet_manager.cc:1397] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260812 11:24:59.681506 17828 tablet_bootstrap.cc:654] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: Neither blocks nor log segments found. Creating new log.
I20260812 11:24:59.682396 17828 log.cc:824] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: Log is configured to *not* fsync() on all Append() calls
I20260812 11:24:59.684347 17828 tablet_bootstrap.cc:492] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: No bootstrap required, opened a new log
I20260812 11:24:59.684347 17827 raft_consensus.cc:348] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.684528 17828 ts_tablet_manager.cc:1397] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:24:59.684572 17827 raft_consensus.cc:374] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:59.684643 17827 raft_consensus.cc:729] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab4310e0e0e45ae885727e7456649c5, State: Initialized, Role: FOLLOWER
I20260812 11:24:59.685041 17827 consensus_queue.cc:260] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.685416 17825 raft_consensus.cc:348] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.685654 17825 raft_consensus.cc:374] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:59.685716 17825 raft_consensus.cc:729] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf0516c07664a1b9faf5d89b0737175, State: Initialized, Role: FOLLOWER
I20260812 11:24:59.685858 17827 ts_tablet_manager.cc:1428] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260812 11:24:59.686110 17825 consensus_queue.cc:260] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.686205 17790 heartbeater.cc:503] Master 127.12.175.254:36513 was elected leader, sending a full tablet report...
I20260812 11:24:59.686720 17528 heartbeater.cc:503] Master 127.12.175.254:36513 was elected leader, sending a full tablet report...
I20260812 11:24:59.687008 17825 ts_tablet_manager.cc:1428] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260812 11:24:59.689119 17828 raft_consensus.cc:348] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.689311 17828 raft_consensus.cc:374] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:24:59.689391 17828 raft_consensus.cc:729] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8abdc336bb7944a785d7088a20006880, State: Initialized, Role: FOLLOWER
I20260812 11:24:59.689855 17828 consensus_queue.cc:260] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.690081 17842 raft_consensus.cc:482] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:24:59.690264 17842 raft_consensus.cc:504] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.690541 17295 heartbeater.cc:503] Master 127.12.175.254:36513 was elected leader, sending a full tablet report...
I20260812 11:24:59.690762 17828 ts_tablet_manager.cc:1428] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:24:59.691696 17842 leader_election.cc:288] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf0516c07664a1b9faf5d89b0737175 (127.12.175.194:46163), 3ab4310e0e0e45ae885727e7456649c5 (127.12.175.195:46437)
I20260812 11:24:59.695638 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.691490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:46163 (local address 127.12.175.193:33875)
0812 11:24:59.691600 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.691616 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.691695 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.692262 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.692265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.692282 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:59.692385 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.692393 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.693319 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.693323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.694474 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.694485 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.695321 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.695325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.695420 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.695441 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.695497 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.695550 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 11:24:59.695688 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.691538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:33875 (local address 127.12.175.194:46163)
0812 11:24:59.692077 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.692081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.692094 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:24:59.692133 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.692136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.692175 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.692236 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:59.692505 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.693195 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.694590 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.695174 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.695311 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.695358 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.695520 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.695582 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467}
I20260812 11:24:59.696257 17440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a57a539cb345a2a1cec50278db7e6e" candidate_uuid: "8abdc336bb7944a785d7088a20006880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf0516c07664a1b9faf5d89b0737175" is_pre_election: true
I20260812 11:24:59.696492 17440 raft_consensus.cc:2454] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8abdc336bb7944a785d7088a20006880 in term 0.
W20260812 11:24:59.696707 17530 tablet.cc:2369] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:24:59.696969 17103 leader_election.cc:302] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8abdc336bb7944a785d7088a20006880, cdf0516c07664a1b9faf5d89b0737175; no voters:
I20260812 11:24:59.697175 17842 raft_consensus.cc:2781] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:24:59.697249 17842 raft_consensus.cc:482] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:24:59.697279 17842 raft_consensus.cc:3037] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:59.697571 17820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.692579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:39285 (local address 127.12.175.195:46437)
0812 11:24:59.692680 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.692684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.693416 (+ 732us) server_negotiation.cc:407] Connection header received
0812 11:24:59.693583 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.693587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.693631 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.693711 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:24:59.693899 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.694573 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.695883 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.696436 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.696524 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.696579 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.697391 (+ 812us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.697453 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:24:59.697578 17845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.692499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:46437 (local address 127.12.175.193:39285)
0812 11:24:59.693344 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.693356 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:24:59.693479 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:24:59.693715 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:24:59.693716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:24:59.693729 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:24:59.693823 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.693826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.694657 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.694660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.695748 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:24:59.695759 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.697183 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.697187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:24:59.697266 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.697289 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:24:59.697373 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:24:59.697435 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":98,"threads_started":1}
I20260812 11:24:59.698091 17704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a57a539cb345a2a1cec50278db7e6e" candidate_uuid: "8abdc336bb7944a785d7088a20006880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab4310e0e0e45ae885727e7456649c5" is_pre_election: true
I20260812 11:24:59.698293 17704 raft_consensus.cc:2454] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8abdc336bb7944a785d7088a20006880 in term 0.
I20260812 11:24:59.698315 17842 raft_consensus.cc:504] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.698625 17842 leader_election.cc:288] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [CANDIDATE]: Term 1 election: Requested vote from peers cdf0516c07664a1b9faf5d89b0737175 (127.12.175.194:46163), 3ab4310e0e0e45ae885727e7456649c5 (127.12.175.195:46437)
I20260812 11:24:59.698944 17440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a57a539cb345a2a1cec50278db7e6e" candidate_uuid: "8abdc336bb7944a785d7088a20006880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf0516c07664a1b9faf5d89b0737175"
I20260812 11:24:59.699062 17704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72a57a539cb345a2a1cec50278db7e6e" candidate_uuid: "8abdc336bb7944a785d7088a20006880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab4310e0e0e45ae885727e7456649c5"
I20260812 11:24:59.699055 17440 raft_consensus.cc:3037] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:59.699162 17704 raft_consensus.cc:3037] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:24:59.699965 17440 raft_consensus.cc:2454] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8abdc336bb7944a785d7088a20006880 in term 1.
I20260812 11:24:59.700062 17704 raft_consensus.cc:2454] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8abdc336bb7944a785d7088a20006880 in term 1.
I20260812 11:24:59.700217 17103 leader_election.cc:302] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8abdc336bb7944a785d7088a20006880, cdf0516c07664a1b9faf5d89b0737175; no voters:
I20260812 11:24:59.700364 17842 raft_consensus.cc:2781] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:24:59.700456 17842 raft_consensus.cc:686] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [term 1 LEADER]: Becoming Leader. State: Replica: 8abdc336bb7944a785d7088a20006880, State: Running, Role: LEADER
I20260812 11:24:59.700688 17842 consensus_queue.cc:237] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } }
I20260812 11:24:59.703169 16975 catalog_manager.cc:5495] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8abdc336bb7944a785d7088a20006880 (127.12.175.193). New cstate: current_term: 1 leader_uuid: "8abdc336bb7944a785d7088a20006880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8abdc336bb7944a785d7088a20006880" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 37503 } health_report { overall_health: HEALTHY } } }
I20260812 11:24:59.713330 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.710207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56680 (local address 127.12.175.193:37503)
0812 11:24:59.710312 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:24:59.710315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:24:59.710328 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:24:59.710475 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:24:59.710478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:24:59.710526 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:24:59.710603 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:24:59.710791 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.711233 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.712072 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:24:59.712279 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:24:59.712360 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:24:59.712640 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:24:59.712976 (+ 336us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:24:59.713122 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:24:59.713162 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 11:24:59.713190 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:24:59.718300 17440 raft_consensus.cc:1261] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 1 FOLLOWER]: Refusing update from remote peer 8abdc336bb7944a785d7088a20006880: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:59.718302 17704 raft_consensus.cc:1261] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 1 FOLLOWER]: Refusing update from remote peer 8abdc336bb7944a785d7088a20006880: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:24:59.718956 17844 consensus_queue.cc:1035] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ab4310e0e0e45ae885727e7456649c5" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 46437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:59.719110 17842 consensus_queue.cc:1035] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf0516c07664a1b9faf5d89b0737175" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 46163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:24:59.735735 16971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:59.735904 16971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:24:59.738399 16971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0432c10acdc47caba9880e52be1504e: Sending DeleteTablet for 3 replicas of tablet 72a57a539cb345a2a1cec50278db7e6e
I20260812 11:24:59.739133 17657 tablet_service.cc:1514] Processing DeleteTablet for tablet 72a57a539cb345a2a1cec50278db7e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:59 UTC) from {username='slave'} at 127.0.0.1:48416
I20260812 11:24:59.739140 17403 tablet_service.cc:1514] Processing DeleteTablet for tablet 72a57a539cb345a2a1cec50278db7e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:59 UTC) from {username='slave'} at 127.0.0.1:46382
I20260812 11:24:59.739591 17870 tablet_replica.cc:330] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: stopping tablet replica
I20260812 11:24:59.739593 17869 tablet_replica.cc:330] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: stopping tablet replica
I20260812 11:24:59.739827 17183 tablet_service.cc:1514] Processing DeleteTablet for tablet 72a57a539cb345a2a1cec50278db7e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:24:59 UTC) from {username='slave'} at 127.0.0.1:45776
I20260812 11:24:59.739889 17870 raft_consensus.cc:2229] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:59.740008 17869 raft_consensus.cc:2229] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:24:59.740170 17870 raft_consensus.cc:2258] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:59.740470 17873 tablet_replica.cc:330] T 72a57a539cb345a2a1cec50278db7e6e P 8abdc336bb7944a785d7088a20006880: stopping tablet replica
I20260812 11:24:59.740559 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17079
I20260812 11:24:59.744800 17870 ts_tablet_manager.cc:1905] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:59.746930 17870 ts_tablet_manager.cc:1918] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:59.747008 17870 log.cc:1196] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/72a57a539cb345a2a1cec50278db7e6e
I20260812 11:24:59.747308 17870 ts_tablet_manager.cc:1939] T 72a57a539cb345a2a1cec50278db7e6e P cdf0516c07664a1b9faf5d89b0737175: Deleting consensus metadata
I20260812 11:24:59.748317 16943 catalog_manager.cc:4841] TS cdf0516c07664a1b9faf5d89b0737175 (127.12.175.194:46163): tablet 72a57a539cb345a2a1cec50278db7e6e (table test-table [id=fca09e9a5d9f4432ac82af517f0cb934]) successfully deleted
I20260812 11:24:59.757532 17869 raft_consensus.cc:2258] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:24:59.758764 17869 ts_tablet_manager.cc:1905] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:24:59.760813 17869 ts_tablet_manager.cc:1918] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:24:59.760897 17869 log.cc:1196] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/72a57a539cb345a2a1cec50278db7e6e
I20260812 11:24:59.761137 17869 ts_tablet_manager.cc:1939] T 72a57a539cb345a2a1cec50278db7e6e P 3ab4310e0e0e45ae885727e7456649c5: Deleting consensus metadata
I20260812 11:24:59.762094 16945 catalog_manager.cc:4841] TS 3ab4310e0e0e45ae885727e7456649c5 (127.12.175.195:46437): tablet 72a57a539cb345a2a1cec50278db7e6e (table test-table [id=fca09e9a5d9f4432ac82af517f0cb934]) successfully deleted
W20260812 11:24:59.763644 16945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:37503 (error 108)
I20260812 11:24:59.763770 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17302
I20260812 11:24:59.766338 17817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:24:59.766086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:37503 (local address 127.0.0.1:56692)
0812 11:24:59.766204 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 11:24:59.766267 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:37503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 11:24:59.766498 16945 catalog_manager.cc:4584] TS 8abdc336bb7944a785d7088a20006880 (127.12.175.193:37503): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 72a57a539cb345a2a1cec50278db7e6e: Network error: Client connection negotiation failed: client connection to 127.12.175.193:37503: connect: Connection refused (error 111)
I20260812 11:24:59.792814 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17534
I20260812 11:24:59.803810 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 16921
2026-08-12T11:24:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (976 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:24:59 dist-test-slave-gjrz krb5kdc[17879](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:24:59 dist-test-slave-gjrz krb5kdc[17879](info): set up 2 sockets
Aug 12 11:24:59 dist-test-slave-gjrz krb5kdc[17879](info): commencing operation
krb5kdc: starting...
W20260812 11:25:00.995580 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:01.109714 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42875
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:32973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:42875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:01.215005 17902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:01.215224 17902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:01.215299 17902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:01.219103 17902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:01.219151 17902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:01.219177 17902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:01.219197 17902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:01.219223 17902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:01.224152 17902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:32973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:42875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:42875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:01.225009 17902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:01.225874 17902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:01.233795 17912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:01.233790 17909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:01.233907 17902 server_base.cc:1034] running on GCE node
W20260812 11:25:01.233791 17910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:01.234592 17902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:01.235574 17902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:01.236725 17902 hybrid_clock.cc:648] HybridClock initialized: now 1786533901236701 us; error 35 us; skew 500 ppm
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:01.239151 17902 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:01.239964 17902 webserver.cc:460] Webserver started at http://127.12.175.254:39011/ using document root <none> and password file <none>
I20260812 11:25:01.240450 17902 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:01.240514 17902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:01.240696 17902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:01.242529 17902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "dac75c88e51d4716ac0b7f4f85133636"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "e057e5acf7efcad0bdb706ae60d59ed4"
server_key_iv: "95bd1a00f316a168fc37e05b22fcf8e8"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.243045 17902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "dac75c88e51d4716ac0b7f4f85133636"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "e057e5acf7efcad0bdb706ae60d59ed4"
server_key_iv: "95bd1a00f316a168fc37e05b22fcf8e8"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.246398 17902 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:25:01.248526 17926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.249583 17902 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:25:01.249698 17902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "dac75c88e51d4716ac0b7f4f85133636"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "e057e5acf7efcad0bdb706ae60d59ed4"
server_key_iv: "95bd1a00f316a168fc37e05b22fcf8e8"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.249785 17902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:01.272399 17902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:01.274812 17902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:01.274967 17902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:01.281239 17902 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:42875
I20260812 11:25:01.281257 18023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:42875 every 8 connection(s)
I20260812 11:25:01.282073 17902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:01.284627 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 17902
I20260812 11:25:01.284693 18027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:01.284755 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:01.285006 12991 external_mini_cluster.cc:1428] Setting key ca7dcf86ddc5e0fa979d2c844affb4fe
I20260812 11:25:01.291244 18027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636: Bootstrap starting.
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:01.293735 18027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:01.294581 18027 log.cc:824] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:01.296626 18027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636: No bootstrap required, opened a new log
I20260812 11:25:01.298450 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.286174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.12.175.254:42875)
0812 11:25:01.286530 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.286545 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.286579 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:25:01.287224 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.287241 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.287586 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.287841 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:01.288722 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.289664 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.290813 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.291249 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.291419 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.293934 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:01.293941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:01.293957 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:01.293990 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:01.295674 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.296065 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.296071 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.296077 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.296209 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.296440 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.296443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.296445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.296914 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:01.297098 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.297300 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.297574 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":100,"threads_started":1}
I20260812 11:25:01.300649 18027 raft_consensus.cc:348] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac75c88e51d4716ac0b7f4f85133636" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42875 } }
I20260812 11:25:01.300841 18027 raft_consensus.cc:374] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:01.300880 18027 raft_consensus.cc:729] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dac75c88e51d4716ac0b7f4f85133636, State: Initialized, Role: FOLLOWER
I20260812 11:25:01.301205 18027 consensus_queue.cc:260] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac75c88e51d4716ac0b7f4f85133636" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42875 } }
I20260812 11:25:01.301319 18027 raft_consensus.cc:388] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:01.301362 18027 raft_consensus.cc:482] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:01.301427 18027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:01.302160 18027 raft_consensus.cc:504] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac75c88e51d4716ac0b7f4f85133636" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42875 } }
I20260812 11:25:01.302430 18027 leader_election.cc:302] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dac75c88e51d4716ac0b7f4f85133636; no voters:
I20260812 11:25:01.302659 18027 leader_election.cc:288] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:01.302755 18044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:01.302961 18044 raft_consensus.cc:686] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [term 1 LEADER]: Becoming Leader. State: Replica: dac75c88e51d4716ac0b7f4f85133636, State: Running, Role: LEADER
I20260812 11:25:01.303252 18044 consensus_queue.cc:237] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac75c88e51d4716ac0b7f4f85133636" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42875 } }
I20260812 11:25:01.303745 18027 sys_catalog.cc:564] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:01.304742 18047 sys_catalog.cc:455] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dac75c88e51d4716ac0b7f4f85133636. Latest consensus state: current_term: 1 leader_uuid: "dac75c88e51d4716ac0b7f4f85133636" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac75c88e51d4716ac0b7f4f85133636" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42875 } } }
I20260812 11:25:01.304872 18047 sys_catalog.cc:458] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:01.305238 18046 sys_catalog.cc:455] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dac75c88e51d4716ac0b7f4f85133636" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac75c88e51d4716ac0b7f4f85133636" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 42875 } } }
I20260812 11:25:01.305382 18046 sys_catalog.cc:458] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:01.305318 18060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:01.308058 18060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:01.313124 18060 catalog_manager.cc:1347] Generated new cluster ID: 0ea29e0ef82f478f9e56de635622bf00
I20260812 11:25:01.313174 18060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:01.330324 18060 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:01.331099 18060 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:01.338464 18060 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636: Generated new TSK 0
I20260812 11:25:01.339017 18060 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
Entry for principal kudu/127.12.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab.
I20260812 11:25:01.368242 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42875
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:32973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:01.473881 18076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:01.474102 18076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:01.474144 18076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:01.477965 18076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:01.478010 18076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:01.478082 18076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:25:01.482966 18076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:32973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.193.keytab
--principal=kudu/127.12.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:01.483850 18076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:01.484740 18076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:01.494294 18099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:01.494275 18089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:01.494379 18095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:01.495191 18076 server_base.cc:1034] running on GCE node
I20260812 11:25:01.495625 18076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:01.496306 18076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:01.497429 18076 hybrid_clock.cc:648] HybridClock initialized: now 1786533901497362 us; error 79 us; skew 500 ppm
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:01.500562 18076 init.cc:377] Logged in from keytab as kudu/127.12.175.193@KRBTEST.COM (short username kudu)
I20260812 11:25:01.501298 18076 webserver.cc:460] Webserver started at http://127.12.175.193:39937/ using document root <none> and password file <none>
I20260812 11:25:01.501799 18076 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:01.501863 18076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:01.502064 18076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:01.504068 18076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "062b2dfe8480c907dddff10ae33428cb"
server_key_iv: "4b387d0d25549492dedad1cd4e4e120b"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.504602 18076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "062b2dfe8480c907dddff10ae33428cb"
server_key_iv: "4b387d0d25549492dedad1cd4e4e120b"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.508002 18076 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:25:01.510092 18117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.511147 18076 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:01.511248 18076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "062b2dfe8480c907dddff10ae33428cb"
server_key_iv: "4b387d0d25549492dedad1cd4e4e120b"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.511368 18076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:01.525015 18076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:01.527707 18076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:01.527858 18076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:01.528344 18076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:25:01.529067 18076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:25:01.529114 18076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.529160 18076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:25:01.529187 18076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.537375 18076 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:40137
I20260812 11:25:01.537400 18335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:40137 every 8 connection(s)
I20260812 11:25:01.538136 18076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:25:01.543668 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18076
I20260812 11:25:01.543800 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:25:01.544103 12991 external_mini_cluster.cc:1428] Setting key 2c0107d4aeaae32df7f5db20c91e02e1
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.193@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:01.550719 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.539709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:55959 (local address 127.12.175.254:42875)
0812 11:25:01.539838 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.539843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.540603 (+ 760us) server_negotiation.cc:407] Connection header received
0812 11:25:01.541736 (+ 1133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.541739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.541784 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.541853 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:01.542858 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.543452 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.544847 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.545116 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.545191 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.547718 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:01.547721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:01.547723 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:01.547745 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:01.548898 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.549350 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.549353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.549354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.549427 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.549738 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.549741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.549743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.549907 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:01.549991 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.550440 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.550558 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":43}
I20260812 11:25:01.551447 18340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.540054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42875 (local address 127.12.175.193:55959)
0812 11:25:01.540471 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:01.540509 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:01.541565 (+ 1056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:01.542000 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:01.542006 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:01.542320 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:01.542747 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.542761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.543570 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.543574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.544739 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.544749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.545257 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.545260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.545441 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.545939 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:01.545954 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:01.547562 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:01.549005 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:01.549011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:01.549024 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:01.549255 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:01.549509 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:01.549512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:01.549514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:01.549650 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:01.550006 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:01.550013 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:01.550228 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 11:25:01.550380 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:25:01.550681 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":112,"threads_started":1}
I20260812 11:25:01.552585 18336 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42875
I20260812 11:25:01.552815 18336 heartbeater.cc:464] Registering TS with master...
I20260812 11:25:01.553336 18336 heartbeater.cc:511] Master 127.12.175.254:42875 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.175.194@KRBTEST.COM; defaulting to no policy
I20260812 11:25:01.554811 17960 ts_manager.cc:194] Registered new tserver with Master: c5c102c5848f49f28aa3b8cc2ff1ae89 (127.12.175.193:40137)
I20260812 11:25:01.555927 17960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.193@KRBTEST.COM'} at 127.12.175.193:55959
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
Entry for principal kudu/127.12.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab.
I20260812 11:25:01.570235 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42875
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:32973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:01.675318 18344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:01.675539 18344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:01.675580 18344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:01.679396 18344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:01.679441 18344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:01.679510 18344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:25:01.684406 18344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:32973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.194.keytab
--principal=kudu/127.12.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:01.685266 18344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:01.686197 18344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:01.695227 18351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:01.695293 18344 server_base.cc:1034] running on GCE node
W20260812 11:25:01.695240 18355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:01.695392 18352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:01.695881 18344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:01.696506 18344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:01.697664 18344 hybrid_clock.cc:648] HybridClock initialized: now 1786533901697636 us; error 35 us; skew 500 ppm
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:01.700210 18344 init.cc:377] Logged in from keytab as kudu/127.12.175.194@KRBTEST.COM (short username kudu)
I20260812 11:25:01.700973 18344 webserver.cc:460] Webserver started at http://127.12.175.194:34341/ using document root <none> and password file <none>
I20260812 11:25:01.701460 18344 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:01.701542 18344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:01.701716 18344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:01.703610 18344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "11b107f7c63744d7899f8a27e5e7b7f8"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "be3048e8e3c784ff7257ddabfa703eb5"
server_key_iv: "57c2ec2dcbc7f0e54b3f4c0459f322a5"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.704123 18344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "11b107f7c63744d7899f8a27e5e7b7f8"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "be3048e8e3c784ff7257ddabfa703eb5"
server_key_iv: "57c2ec2dcbc7f0e54b3f4c0459f322a5"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.707547 18344 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:25:01.709659 18369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.710708 18344 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:01.710809 18344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "11b107f7c63744d7899f8a27e5e7b7f8"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "be3048e8e3c784ff7257ddabfa703eb5"
server_key_iv: "57c2ec2dcbc7f0e54b3f4c0459f322a5"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.710891 18344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:01.722329 18344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:01.725098 18344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:01.725250 18344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:01.725736 18344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:25:01.726462 18344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:25:01.726507 18344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.726557 18344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:25:01.726585 18344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.734522 18344 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:36017
I20260812 11:25:01.734556 18599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:36017 every 8 connection(s)
I20260812 11:25:01.735411 18344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.194@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:01.745255 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18344
I20260812 11:25:01.745368 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:25:01.745646 12991 external_mini_cluster.cc:1428] Setting key 941a62c2c9edaed5587df781d05a149f
I20260812 11:25:01.747591 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.736984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:45755 (local address 127.12.175.254:42875)
0812 11:25:01.737103 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.737107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.737828 (+ 721us) server_negotiation.cc:407] Connection header received
0812 11:25:01.739006 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.739009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.739063 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.739134 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:01.740193 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.740704 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.741724 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.741929 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.741995 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.744239 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:01.744243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:01.744245 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:01.744270 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:01.745565 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.746097 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.746101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.746103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.746205 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.746542 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.746545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.746546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.746742 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:01.746835 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.747376 (+ 541us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.747476 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:25:01.748512 18611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.737278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42875 (local address 127.12.175.194:45755)
0812 11:25:01.737680 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:01.737719 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:01.738825 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:01.739303 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:01.739312 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:01.739627 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:01.740082 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.740096 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.740789 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.740791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.741636 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.741645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.742031 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.742033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.742175 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.742623 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:01.742638 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:01.744093 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:01.745670 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:01.745676 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:01.745690 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:01.745997 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:01.746286 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:01.746289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:01.746291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:01.746460 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:01.746825 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:01.746829 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:01.747096 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 11:25:01.747305 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 11:25:01.747602 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":100,"threads_started":1}
I20260812 11:25:01.750056 18600 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42875
I20260812 11:25:01.750258 18600 heartbeater.cc:464] Registering TS with master...
I20260812 11:25:01.750679 18600 heartbeater.cc:511] Master 127.12.175.254:42875 requested a full tablet report, sending...
I20260812 11:25:01.751598 17960 ts_manager.cc:194] Registered new tserver with Master: 11b107f7c63744d7899f8a27e5e7b7f8 (127.12.175.194:36017)
I20260812 11:25:01.752116 17960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.194@KRBTEST.COM'} at 127.12.175.194:45755
WARNING: no policy specified for kudu/127.12.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
Entry for principal kudu/127.12.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab.
I20260812 11:25:01.772176 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42875
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:32973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:01.877539 18617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:01.877735 18617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:01.877772 18617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:01.881564 18617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:01.881610 18617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:01.881662 18617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:25:01.886518 18617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:32973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.195.keytab
--principal=kudu/127.12.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:42875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:01.887341 18617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:01.888173 18617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:01.896584 18631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:01.896593 18627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:01.896597 18626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:01.896737 18617 server_base.cc:1034] running on GCE node
I20260812 11:25:01.897172 18617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:01.897696 18617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:01.898897 18617 hybrid_clock.cc:648] HybridClock initialized: now 1786533901898859 us; error 24 us; skew 500 ppm
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:01.901487 18617 init.cc:377] Logged in from keytab as kudu/127.12.175.195@KRBTEST.COM (short username kudu)
I20260812 11:25:01.902319 18617 webserver.cc:460] Webserver started at http://127.12.175.195:35159/ using document root <none> and password file <none>
I20260812 11:25:01.902830 18617 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:01.902901 18617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:01.903095 18617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:01.905067 18617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "51ef6281c38d444e984afadb88f9bfdf"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "42d309c27f30c523ce1e9852ce527e9b"
server_key_iv: "3e7744c7f7dc5b01446c2cfe021603ed"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.905582 18617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "51ef6281c38d444e984afadb88f9bfdf"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "42d309c27f30c523ce1e9852ce527e9b"
server_key_iv: "3e7744c7f7dc5b01446c2cfe021603ed"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.909092 18617 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:25:01.911235 18638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.912388 18617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:01.912488 18617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "51ef6281c38d444e984afadb88f9bfdf"
format_stamp: "Formatted at 2026-08-12 11:25:01 on dist-test-slave-gjrz"
server_key: "42d309c27f30c523ce1e9852ce527e9b"
server_key_iv: "3e7744c7f7dc5b01446c2cfe021603ed"
server_key_version: "encryptionkey@0"
I20260812 11:25:01.912586 18617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:01.938118 18617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:01.940977 18617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:01.941138 18617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:01.941648 18617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:25:01.942399 18617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:25:01.942446 18617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.942485 18617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:25:01.942514 18617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:01.950644 18617 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:39789
I20260812 11:25:01.950670 18850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:39789 every 8 connection(s)
I20260812 11:25:01.951471 18617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:25:01.957494 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18617
I20260812 11:25:01.957598 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:25:01.957855 12991 external_mini_cluster.cc:1428] Setting key 68f923e8551aef09e434b278e47854b1
Aug 12 11:25:01 dist-test-slave-gjrz krb5kdc[17879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533901, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.195@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:01.963920 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.953072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:48815 (local address 127.12.175.254:42875)
0812 11:25:01.953221 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.953226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.954042 (+ 816us) server_negotiation.cc:407] Connection header received
0812 11:25:01.955332 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.955336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.955395 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.955467 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:01.956513 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.957041 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.958224 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.958520 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.958622 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.961080 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:01.961083 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:01.961085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:01.961106 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:01.962284 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.962735 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.962738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.962739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.962819 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.963076 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.963078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.963079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.963230 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:01.963349 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.963718 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.963809 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:25:01.964627 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.953437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:42875 (local address 127.12.175.195:48815)
0812 11:25:01.953894 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:01.953939 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:01.955104 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:01.955607 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:01.955613 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:01.955914 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:01.956377 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.956390 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.957134 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.957136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.958099 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.958112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.958790 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.958795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.958971 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.959523 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:01.959538 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:01.960924 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:01.962383 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:01.962387 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:01.962397 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:01.962628 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:01.962894 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:01.962896 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:01.962897 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:01.963010 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:01.963337 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:01.963341 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:01.963538 (+ 197us) client_negotiation.cc:769] Sending connection context
0812 11:25:01.963681 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 11:25:01.963931 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":126,"threads_started":1}
I20260812 11:25:01.965560 18852 heartbeater.cc:347] Connected to a master server at 127.12.175.254:42875
I20260812 11:25:01.965749 18852 heartbeater.cc:464] Registering TS with master...
I20260812 11:25:01.966166 18852 heartbeater.cc:511] Master 127.12.175.254:42875 requested a full tablet report, sending...
I20260812 11:25:01.967022 17960 ts_manager.cc:194] Registered new tserver with Master: 51ef6281c38d444e984afadb88f9bfdf (127.12.175.195:39789)
I20260812 11:25:01.967585 17960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.175.195@KRBTEST.COM'} at 127.12.175.195:48815
I20260812 11:25:01.971145 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:25:01.978736 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.972893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48464 (local address 127.12.175.254:42875)
0812 11:25:01.973014 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.973018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.973178 (+ 160us) server_negotiation.cc:407] Connection header received
0812 11:25:01.973277 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.973279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.973314 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.973365 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:01.973915 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.974382 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.975101 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.975342 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.975406 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.976520 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:01.976522 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:01.976524 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:01.976538 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:01.977534 (+ 996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.977860 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.977862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.977863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.977923 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:01.978103 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:01.978104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:01.978105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:01.978278 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:01.978370 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.978523 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.978603 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:25:01.980997 17960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:25:01.983853 17960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:25:01.996532 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.991026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:39789 (local address 127.0.0.1:56906)
0812 11:25:01.991516 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:01.991564 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:01.991688 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:01.992376 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:01.992381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:01.992404 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:01.992511 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.992517 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.993850 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.993854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.995034 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.995044 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.996031 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.996034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.996137 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.996175 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:25:01.996289 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 11:25:01.996403 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":42,"thread_start_us":63,"threads_started":1}
I20260812 11:25:01.996562 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.991139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56906 (local address 127.12.175.195:39789)
0812 11:25:01.991539 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.991551 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.991815 (+ 264us) server_negotiation.cc:407] Connection header received
0812 11:25:01.991884 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.991889 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.992084 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.992223 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:01.992615 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.993717 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.995163 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.995908 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.996026 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.996145 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.996326 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.996418 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":119,"threads_started":1}
I20260812 11:25:01.996873 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.991158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36017 (local address 127.0.0.1:49726)
0812 11:25:01.991678 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:01.991690 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:01.991763 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:01.992662 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:01.992665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:01.992685 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:01.992782 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.992791 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.994180 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.994183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.995453 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.995464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.996507 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.996510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.996607 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.996631 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:25:01.996682 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 11:25:01.996748 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":23,"thread_start_us":75,"threads_started":1}
I20260812 11:25:01.997041 18879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.991713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:40137 (local address 127.0.0.1:35390)
0812 11:25:01.992546 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:01.992558 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:01.992631 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:01.993120 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:01.993123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:01.993140 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:01.993239 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.993245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.994344 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.994348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.995527 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:01.995535 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.996597 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.996600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:01.996708 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.996730 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:25:01.996800 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:25:01.996861 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":19,"thread_start_us":100,"threads_started":1}
I20260812 11:25:01.997558 18881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.991788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49726 (local address 127.12.175.194:36017)
0812 11:25:01.992198 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.992210 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.992232 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:25:01.992304 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.992309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.992492 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.992936 (+ 444us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:01.993073 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.994059 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.995596 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.996374 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.997195 (+ 821us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.997308 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.997350 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.997428 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":106,"threads_started":1}
I20260812 11:25:01.997740 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:01.992173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.12.175.193:40137)
0812 11:25:01.992787 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:01.992796 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:01.992813 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:25:01.992869 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:01.992872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:01.992997 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:01.993129 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:01.993345 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.994214 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.995643 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:01.996316 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:01.996418 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:01.996530 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:01.996856 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:25:01.996955 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":108,"threads_started":1}
I20260812 11:25:01.999596 18741 tablet_service.cc:1467] Processing CreateTablet for tablet a487762126c546cc8cb0290351aec521 (DEFAULT_TABLE table=test-table [id=bc59906b4e5c417aabec4b49273d7205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:25:01.999910 18206 tablet_service.cc:1467] Processing CreateTablet for tablet a487762126c546cc8cb0290351aec521 (DEFAULT_TABLE table=test-table [id=bc59906b4e5c417aabec4b49273d7205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:25:02.000691 18741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a487762126c546cc8cb0290351aec521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:02.000751 18206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a487762126c546cc8cb0290351aec521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:02.001124 18453 tablet_service.cc:1467] Processing CreateTablet for tablet a487762126c546cc8cb0290351aec521 (DEFAULT_TABLE table=test-table [id=bc59906b4e5c417aabec4b49273d7205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:25:02.002045 18453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a487762126c546cc8cb0290351aec521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:02.007014 18884 tablet_bootstrap.cc:492] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: Bootstrap starting.
I20260812 11:25:02.008122 18886 tablet_bootstrap.cc:492] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Bootstrap starting.
I20260812 11:25:02.009087 18884 tablet_bootstrap.cc:654] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:02.009073 18887 tablet_bootstrap.cc:492] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Bootstrap starting.
I20260812 11:25:02.010138 18884 log.cc:824] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:02.010196 18886 tablet_bootstrap.cc:654] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:02.011044 18887 tablet_bootstrap.cc:654] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:02.011394 18886 log.cc:824] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:02.012058 18884 tablet_bootstrap.cc:492] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: No bootstrap required, opened a new log
I20260812 11:25:02.012244 18887 log.cc:824] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:02.012323 18884 ts_tablet_manager.cc:1397] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:25:02.013185 18886 tablet_bootstrap.cc:492] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: No bootstrap required, opened a new log
I20260812 11:25:02.013383 18886 ts_tablet_manager.cc:1397] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260812 11:25:02.014122 18887 tablet_bootstrap.cc:492] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: No bootstrap required, opened a new log
I20260812 11:25:02.014292 18887 ts_tablet_manager.cc:1397] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:25:02.015517 18884 raft_consensus.cc:348] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.015718 18884 raft_consensus.cc:374] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:02.015787 18884 raft_consensus.cc:729] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c102c5848f49f28aa3b8cc2ff1ae89, State: Initialized, Role: FOLLOWER
I20260812 11:25:02.016247 18884 consensus_queue.cc:260] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.016990 18884 ts_tablet_manager.cc:1428] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:25:02.017323 18336 heartbeater.cc:503] Master 127.12.175.254:42875 was elected leader, sending a full tablet report...
I20260812 11:25:02.016997 18886 raft_consensus.cc:348] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.018040 18887 raft_consensus.cc:348] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.018270 18887 raft_consensus.cc:374] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:02.018342 18886 raft_consensus.cc:374] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:02.018360 18887 raft_consensus.cc:729] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b107f7c63744d7899f8a27e5e7b7f8, State: Initialized, Role: FOLLOWER
I20260812 11:25:02.018440 18886 raft_consensus.cc:729] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ef6281c38d444e984afadb88f9bfdf, State: Initialized, Role: FOLLOWER
I20260812 11:25:02.018801 18887 consensus_queue.cc:260] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.018833 18886 consensus_queue.cc:260] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.019642 18852 heartbeater.cc:503] Master 127.12.175.254:42875 was elected leader, sending a full tablet report...
I20260812 11:25:02.019690 18600 heartbeater.cc:503] Master 127.12.175.254:42875 was elected leader, sending a full tablet report...
I20260812 11:25:02.019745 18887 ts_tablet_manager.cc:1428] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:25:02.020380 18886 ts_tablet_manager.cc:1428] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260812 11:25:02.039081 18339 tablet.cc:2369] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:25:02.202349 18854 tablet.cc:2369] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:25:02.234536 18899 raft_consensus.cc:482] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:25:02.234742 18899 raft_consensus.cc:504] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.235882 18899 leader_election.cc:288] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b107f7c63744d7899f8a27e5e7b7f8 (127.12.175.194:36017), c5c102c5848f49f28aa3b8cc2ff1ae89 (127.12.175.193:40137)
W20260812 11:25:02.236497 18606 tablet.cc:2369] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:25:02.239723 18881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.236213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:47583 (local address 127.12.175.194:36017)
0812 11:25:02.236335 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:02.236339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:02.236566 (+ 227us) server_negotiation.cc:407] Connection header received
0812 11:25:02.236702 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:02.236706 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:02.236756 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:02.236800 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:02.237247 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.237738 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.238743 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.239120 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.239223 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.239301 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:02.239549 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 11:25:02.239624 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:25:02.239717 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.236213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:36257 (local address 127.12.175.193:40137)
0812 11:25:02.236335 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:02.236339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:02.236355 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:25:02.236538 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:02.236542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:02.236605 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:02.236687 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:02.237099 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.237660 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.238730 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.239117 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.239224 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.239303 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:02.239529 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 11:25:02.239604 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:25:02.239715 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.236099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:40137 (local address 127.12.175.195:36257)
0812 11:25:02.236301 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:02.236316 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:02.236417 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:02.236817 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:02.236820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:02.236841 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:02.236959 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.236966 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.237773 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.237776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.238593 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.238602 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.239231 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.239234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.239409 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.239433 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:25:02.239495 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 11:25:02.239567 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":33}
I20260812 11:25:02.239732 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.236107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:36017 (local address 127.12.175.195:47583)
0812 11:25:02.236474 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:02.236487 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:02.236582 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:02.236986 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:02.236988 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:02.237005 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:02.237132 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.237139 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.237843 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.237846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.238618 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.238627 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.239224 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.239228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.239421 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.239440 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 11:25:02.239509 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:25:02.239575 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":69,"thread_start_us":115,"threads_started":1}
I20260812 11:25:02.240304 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a487762126c546cc8cb0290351aec521" candidate_uuid: "51ef6281c38d444e984afadb88f9bfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" is_pre_election: true
I20260812 11:25:02.240413 18496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a487762126c546cc8cb0290351aec521" candidate_uuid: "51ef6281c38d444e984afadb88f9bfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" is_pre_election: true
I20260812 11:25:02.240576 18255 raft_consensus.cc:2454] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51ef6281c38d444e984afadb88f9bfdf in term 0.
I20260812 11:25:02.240677 18496 raft_consensus.cc:2454] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51ef6281c38d444e984afadb88f9bfdf in term 0.
I20260812 11:25:02.241066 18642 leader_election.cc:302] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51ef6281c38d444e984afadb88f9bfdf, c5c102c5848f49f28aa3b8cc2ff1ae89; no voters:
I20260812 11:25:02.241344 18899 raft_consensus.cc:2781] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:25:02.241422 18899 raft_consensus.cc:482] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:25:02.241452 18899 raft_consensus.cc:3037] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:02.242463 18899 raft_consensus.cc:504] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.242787 18899 leader_election.cc:288] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [CANDIDATE]: Term 1 election: Requested vote from peers 11b107f7c63744d7899f8a27e5e7b7f8 (127.12.175.194:36017), c5c102c5848f49f28aa3b8cc2ff1ae89 (127.12.175.193:40137)
I20260812 11:25:02.243124 18496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a487762126c546cc8cb0290351aec521" candidate_uuid: "51ef6281c38d444e984afadb88f9bfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b107f7c63744d7899f8a27e5e7b7f8"
I20260812 11:25:02.243194 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a487762126c546cc8cb0290351aec521" candidate_uuid: "51ef6281c38d444e984afadb88f9bfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89"
I20260812 11:25:02.243232 18496 raft_consensus.cc:3037] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:02.243345 18255 raft_consensus.cc:3037] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:02.244228 18496 raft_consensus.cc:2454] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51ef6281c38d444e984afadb88f9bfdf in term 1.
I20260812 11:25:02.244374 18255 raft_consensus.cc:2454] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51ef6281c38d444e984afadb88f9bfdf in term 1.
I20260812 11:25:02.244522 18649 leader_election.cc:302] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b107f7c63744d7899f8a27e5e7b7f8, 51ef6281c38d444e984afadb88f9bfdf; no voters:
I20260812 11:25:02.244737 18899 raft_consensus.cc:2781] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:02.244920 18899 raft_consensus.cc:686] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 1 LEADER]: Becoming Leader. State: Replica: 51ef6281c38d444e984afadb88f9bfdf, State: Running, Role: LEADER
I20260812 11:25:02.245204 18899 consensus_queue.cc:237] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } }
I20260812 11:25:02.248227 17956 catalog_manager.cc:5495] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf reported cstate change: term changed from 0 to 1, leader changed from <none> to 51ef6281c38d444e984afadb88f9bfdf (127.12.175.195). New cstate: current_term: 1 leader_uuid: "51ef6281c38d444e984afadb88f9bfdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ef6281c38d444e984afadb88f9bfdf" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 39789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 } health_report { overall_health: UNKNOWN } } }
I20260812 11:25:02.283053 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.279690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56916 (local address 127.12.175.195:39789)
0812 11:25:02.279817 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:02.279821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:02.279835 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:25:02.279956 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:02.279958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:02.280010 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:02.280107 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:02.280345 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.280823 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.281713 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.281937 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.282023 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.282305 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:02.282674 (+ 369us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:02.282782 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:02.282857 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:25:02.282908 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:25:02.288821 18255 raft_consensus.cc:1261] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 1 FOLLOWER]: Refusing update from remote peer 51ef6281c38d444e984afadb88f9bfdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:02.288821 18496 raft_consensus.cc:1261] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 1 FOLLOWER]: Refusing update from remote peer 51ef6281c38d444e984afadb88f9bfdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:02.289494 18899 consensus_queue.cc:1035] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b107f7c63744d7899f8a27e5e7b7f8" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:02.289772 18901 consensus_queue.cc:1035] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c102c5848f49f28aa3b8cc2ff1ae89" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 40137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:02.296586 18914 mvcc.cc:205] Tried to move back new op lower bound from 7317642863767822336 to 7317642863598571520. Current Snapshot: MvccSnapshot[applied={T|T < 7317642863767822336}]
I20260812 11:25:02.296689 18918 mvcc.cc:205] Tried to move back new op lower bound from 7317642863767822336 to 7317642863598571520. Current Snapshot: MvccSnapshot[applied={T|T < 7317642863767822336}]
I20260812 11:25:02.300046 18915 mvcc.cc:205] Tried to move back new op lower bound from 7317642863767822336 to 7317642863598571520. Current Snapshot: MvccSnapshot[applied={T|T < 7317642863767822336 or (T in {7317642863767822336})}]
I20260812 11:25:02.305460 17960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:25:02.305621 17960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:25:02.307749 17960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dac75c88e51d4716ac0b7f4f85133636: Sending DeleteTablet for 3 replicas of tablet a487762126c546cc8cb0290351aec521
I20260812 11:25:02.308431 18453 tablet_service.cc:1514] Processing DeleteTablet for tablet a487762126c546cc8cb0290351aec521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:25:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:49726
I20260812 11:25:02.308514 18741 tablet_service.cc:1514] Processing DeleteTablet for tablet a487762126c546cc8cb0290351aec521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:25:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:56906
I20260812 11:25:02.308903 18928 tablet_replica.cc:330] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: stopping tablet replica
I20260812 11:25:02.308909 18206 tablet_service.cc:1514] Processing DeleteTablet for tablet a487762126c546cc8cb0290351aec521 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:25:02 UTC) from {username='kudu', principal='kudu/127.12.175.254@KRBTEST.COM'} at 127.0.0.1:35390
I20260812 11:25:02.309185 18928 raft_consensus.cc:2229] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:25:02.309324 18932 tablet_replica.cc:330] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89: stopping tablet replica
I20260812 11:25:02.309577 18928 raft_consensus.cc:2258] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:25:02.309624 18932 raft_consensus.cc:2229] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:25:02.309892 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18076
I20260812 11:25:02.309973 18932 raft_consensus.cc:2258] T a487762126c546cc8cb0290351aec521 P c5c102c5848f49f28aa3b8cc2ff1ae89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:25:02.311250 18928 ts_tablet_manager.cc:1905] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:25:02.313956 18928 ts_tablet_manager.cc:1918] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:25:02.315181 18929 tablet_replica.cc:330] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: stopping tablet replica
I20260812 11:25:02.314043 18928 log.cc:1196] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/a487762126c546cc8cb0290351aec521
I20260812 11:25:02.315793 18928 ts_tablet_manager.cc:1939] T a487762126c546cc8cb0290351aec521 P 51ef6281c38d444e984afadb88f9bfdf: Deleting consensus metadata
I20260812 11:25:02.315949 18929 raft_consensus.cc:2229] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:25:02.316637 18929 raft_consensus.cc:2258] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:25:02.319784 18929 ts_tablet_manager.cc:1905] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:25:02.320546 17930 catalog_manager.cc:4841] TS 51ef6281c38d444e984afadb88f9bfdf (127.12.175.195:39789): tablet a487762126c546cc8cb0290351aec521 (table test-table [id=bc59906b4e5c417aabec4b49273d7205]) successfully deleted
I20260812 11:25:02.323297 18929 ts_tablet_manager.cc:1918] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:25:02.323451 18929 log.cc:1196] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/a487762126c546cc8cb0290351aec521
I20260812 11:25:02.323807 18929 ts_tablet_manager.cc:1939] T a487762126c546cc8cb0290351aec521 P 11b107f7c63744d7899f8a27e5e7b7f8: Deleting consensus metadata
I20260812 11:25:02.325037 17931 catalog_manager.cc:4841] TS 11b107f7c63744d7899f8a27e5e7b7f8 (127.12.175.194:36017): tablet a487762126c546cc8cb0290351aec521 (table test-table [id=bc59906b4e5c417aabec4b49273d7205]) successfully deleted
W20260812 11:25:02.326195 17930 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:40137 (error 108)
I20260812 11:25:02.326987 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18344
I20260812 11:25:02.327176 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.326899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:40137 (local address 127.0.0.1:35406)
0812 11:25:02.327022 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:02.327096 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:40137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:25:02.333794 17930 catalog_manager.cc:4584] TS c5c102c5848f49f28aa3b8cc2ff1ae89 (127.12.175.193:40137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a487762126c546cc8cb0290351aec521: Network error: Client connection negotiation failed: client connection to 127.12.175.193:40137: connect: Connection refused (error 111)
I20260812 11:25:02.375974 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18617
I20260812 11:25:02.386653 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 17902
2026-08-12T11:25:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2581 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T11:25:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:02Z Disabled control of system clock
I20260812 11:25:02.418057 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38713
--webserver_interface=127.12.175.254
--webserver_port=0
--builtin_ntp_servers=127.12.175.212:34065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:38713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:25:02.524904 18941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:02.525125 18941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:02.525159 18941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:02.529011 18941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:02.529066 18941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:02.529093 18941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:02.529121 18941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:02.529146 18941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:02.533721 18941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:38713
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:38713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:02.534598 18941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:02.535813 18941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:02.543398 18951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:02.543396 18954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:02.543483 18941 server_base.cc:1034] running on GCE node
W20260812 11:25:02.543393 18957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:02.544104 18941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:02.545068 18941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:02.546222 18941 hybrid_clock.cc:648] HybridClock initialized: now 1786533902546211 us; error 25 us; skew 500 ppm
I20260812 11:25:02.547863 18941 webserver.cc:460] Webserver started at http://127.12.175.254:39847/ using document root <none> and password file <none>
I20260812 11:25:02.548372 18941 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:02.548434 18941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:02.548607 18941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:02.550438 18941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "f0c02b3888274e0386361cff86f2fc05"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "b6c2e4d0c6d6e285fb734034bb1cc198"
server_key_iv: "03d0e417bcc50b483b3307ffd7535477"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.550940 18941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "f0c02b3888274e0386361cff86f2fc05"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "b6c2e4d0c6d6e285fb734034bb1cc198"
server_key_iv: "03d0e417bcc50b483b3307ffd7535477"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.554219 18941 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 11:25:02.556385 18971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.557447 18941 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:25:02.557554 18941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "f0c02b3888274e0386361cff86f2fc05"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "b6c2e4d0c6d6e285fb734034bb1cc198"
server_key_iv: "03d0e417bcc50b483b3307ffd7535477"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.557637 18941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:02.568570 18941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:02.569110 18941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:02.569258 18941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:02.575253 18941 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:38713
I20260812 11:25:02.575296 19058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:38713 every 8 connection(s)
I20260812 11:25:02.576052 18941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:02.578809 19059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:02.583192 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 18941
I20260812 11:25:02.583338 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:02.583666 12991 external_mini_cluster.cc:1428] Setting key 9ce8cefaecfcc8afd1596a1e9136ebb2
I20260812 11:25:02.584100 19059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05: Bootstrap starting.
I20260812 11:25:02.586246 19059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:02.587004 19059 log.cc:824] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:02.588886 19059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05: No bootstrap required, opened a new log
I20260812 11:25:02.592161 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.584899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.12.175.254:38713)
0812 11:25:02.585449 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:02.585462 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:02.585495 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:25:02.586079 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:02.586095 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:02.586471 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:02.586729 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:02.587124 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.588113 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.589258 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.589701 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.589808 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.590584 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:02.590588 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:02.590600 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:02.590933 (+ 333us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:02.590985 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:02.591003 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:02.591088 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:02.591228 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 11:25:02.591501 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":94,"threads_started":1}
I20260812 11:25:02.592538 19059 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0c02b3888274e0386361cff86f2fc05" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38713 } }
I20260812 11:25:02.592746 19059 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:02.592801 19059 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0c02b3888274e0386361cff86f2fc05, State: Initialized, Role: FOLLOWER
I20260812 11:25:02.593168 19059 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0c02b3888274e0386361cff86f2fc05" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38713 } }
I20260812 11:25:02.593292 19059 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:02.593354 19059 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:02.593449 19059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:02.594190 19059 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0c02b3888274e0386361cff86f2fc05" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38713 } }
I20260812 11:25:02.594486 19059 leader_election.cc:302] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0c02b3888274e0386361cff86f2fc05; no voters:
I20260812 11:25:02.594740 19059 leader_election.cc:288] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:02.594848 19067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:02.595052 19067 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [term 1 LEADER]: Becoming Leader. State: Replica: f0c02b3888274e0386361cff86f2fc05, State: Running, Role: LEADER
I20260812 11:25:02.595391 19067 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0c02b3888274e0386361cff86f2fc05" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38713 } }
I20260812 11:25:02.595824 19059 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:02.596922 19074 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0c02b3888274e0386361cff86f2fc05. Latest consensus state: current_term: 1 leader_uuid: "f0c02b3888274e0386361cff86f2fc05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0c02b3888274e0386361cff86f2fc05" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38713 } } }
I20260812 11:25:02.596967 19072 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0c02b3888274e0386361cff86f2fc05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0c02b3888274e0386361cff86f2fc05" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 38713 } } }
I20260812 11:25:02.597126 19074 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:02.597136 19072 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:02.597568 19091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:02.600312 19091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:02.605163 19091 catalog_manager.cc:1347] Generated new cluster ID: 41fac328e69f49b0beee703adef8be6d
I20260812 11:25:02.605213 19091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:02.629297 19091 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:02.630101 19091 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:02.635762 19091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05: Generated new TSK 0
I20260812 11:25:02.636333 19091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:02.644623 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.193:0
--local_ip_for_outbound_sockets=127.12.175.193
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38713
--builtin_ntp_servers=127.12.175.212:34065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:25:02.752386 19106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:02.752601 19106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:02.752636 19106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:02.756474 19106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:02.756515 19106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:02.756582 19106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.193
I20260812 11:25:02.761140 19106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.175.193
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.193
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:02.762099 19106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:02.763347 19106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:02.772246 19116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:02.772243 19121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:02.772279 19119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:02.772562 19106 server_base.cc:1034] running on GCE node
I20260812 11:25:02.772949 19106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:02.773525 19106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:02.774708 19106 hybrid_clock.cc:648] HybridClock initialized: now 1786533902774681 us; error 40 us; skew 500 ppm
I20260812 11:25:02.776425 19106 webserver.cc:460] Webserver started at http://127.12.175.193:41057/ using document root <none> and password file <none>
I20260812 11:25:02.777020 19106 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:02.777109 19106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:02.777292 19106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:02.779132 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data/instance:
uuid: "6f94ea4e10504d3ea8e54fa558c1eb39"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "b0291607d9c308482308dbd0c44b990a"
server_key_iv: "454cb42316215083a5df9d6473be972a"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.779670 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance:
uuid: "6f94ea4e10504d3ea8e54fa558c1eb39"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "b0291607d9c308482308dbd0c44b990a"
server_key_iv: "454cb42316215083a5df9d6473be972a"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.783015 19106 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:25:02.785372 19132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.786468 19106 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:02.786566 19106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal
uuid: "6f94ea4e10504d3ea8e54fa558c1eb39"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "b0291607d9c308482308dbd0c44b990a"
server_key_iv: "454cb42316215083a5df9d6473be972a"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.786669 19106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:02.804942 19106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:02.805485 19106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:02.805632 19106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:02.806138 19106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:25:02.806955 19106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:25:02.807001 19106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.807039 19106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:25:02.807077 19106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.815133 19106 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.193:41591
I20260812 11:25:02.815167 19338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.193:41591 every 8 connection(s)
I20260812 11:25:02.815928 19106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/data/info.pb
I20260812 11:25:02.821121 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19106
I20260812 11:25:02.821234 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-0/wal/instance
I20260812 11:25:02.821507 12991 external_mini_cluster.cc:1428] Setting key 9a033c2df3e922620922f1faee61b320
I20260812 11:25:02.823423 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.194:0
--local_ip_for_outbound_sockets=127.12.175.194
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38713
--builtin_ntp_servers=127.12.175.212:34065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:25:02.825126 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.817536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.193:39481 (local address 127.12.175.254:38713)
0812 11:25:02.817662 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:02.817666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:02.818656 (+ 990us) server_negotiation.cc:407] Connection header received
0812 11:25:02.820056 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:02.820059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:02.820124 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:02.820199 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:02.821079 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.821708 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.823197 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.823510 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.823614 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.824667 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:02.824671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:02.824674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:02.824687 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:02.824706 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:02.824715 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:02.824772 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:02.824919 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 11:25:02.824987 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:25:02.825947 19342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.817858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38713 (local address 127.12.175.193:39481)
0812 11:25:02.818506 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:02.818545 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:02.819831 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:02.820385 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:02.820392 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:02.820474 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:02.820929 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.820948 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.821832 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.821836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.823078 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.823089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.823746 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.823749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.823882 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.824420 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:25:02.824421 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:02.824465 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:25:02.824525 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:02.824783 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:02.824792 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:02.824799 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:25:02.824912 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 11:25:02.825170 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":127,"threads_started":1}
I20260812 11:25:02.827071 19340 heartbeater.cc:347] Connected to a master server at 127.12.175.254:38713
I20260812 11:25:02.827309 19340 heartbeater.cc:464] Registering TS with master...
I20260812 11:25:02.827777 19340 heartbeater.cc:511] Master 127.12.175.254:38713 requested a full tablet report, sending...
I20260812 11:25:02.829102 18995 ts_manager.cc:194] Registered new tserver with Master: 6f94ea4e10504d3ea8e54fa558c1eb39 (127.12.175.193:41591)
I20260812 11:25:02.830209 18995 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.193:39481
W20260812 11:25:02.931983 19343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:02.932212 19343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:02.932262 19343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:02.936141 19343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:02.936183 19343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:02.936254 19343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.194
I20260812 11:25:02.940827 19343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.175.194
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.194
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:02.941728 19343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:02.942977 19343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:02.951973 19355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:02.951939 19367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:02.951949 19359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:02.952255 19343 server_base.cc:1034] running on GCE node
I20260812 11:25:02.952656 19343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:02.953214 19343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:02.954368 19343 hybrid_clock.cc:648] HybridClock initialized: now 1786533902954353 us; error 30 us; skew 500 ppm
I20260812 11:25:02.956063 19343 webserver.cc:460] Webserver started at http://127.12.175.194:35225/ using document root <none> and password file <none>
I20260812 11:25:02.956583 19343 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:02.956648 19343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:02.956826 19343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:02.958710 19343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data/instance:
uuid: "0a24e838ce06404fa8ff3b1b7c27533e"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "6e6b066708016e3f63061ead576691b0"
server_key_iv: "08fa323cdf7b6c474f0447bc176146f0"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.959368 19343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance:
uuid: "0a24e838ce06404fa8ff3b1b7c27533e"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "6e6b066708016e3f63061ead576691b0"
server_key_iv: "08fa323cdf7b6c474f0447bc176146f0"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.962845 19343 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:25:02.965118 19379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.966178 19343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:02.966279 19343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal
uuid: "0a24e838ce06404fa8ff3b1b7c27533e"
format_stamp: "Formatted at 2026-08-12 11:25:02 on dist-test-slave-gjrz"
server_key: "6e6b066708016e3f63061ead576691b0"
server_key_iv: "08fa323cdf7b6c474f0447bc176146f0"
server_key_version: "encryptionkey@0"
I20260812 11:25:02.966365 19343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:02.981317 19343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:02.981864 19343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:02.982031 19343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:02.982527 19343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:25:02.983397 19343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:25:02.983444 19343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.983492 19343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:25:02.983543 19343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:02.991596 19343 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.194:43919
I20260812 11:25:02.991631 19605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.194:43919 every 8 connection(s)
I20260812 11:25:02.992357 19343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/data/info.pb
I20260812 11:25:03.000389 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19343
I20260812 11:25:03.000507 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal/instance
I20260812 11:25:03.000568 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.993927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.194:36163 (local address 127.12.175.254:38713)
0812 11:25:02.994096 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:02.994101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:02.995020 (+ 919us) server_negotiation.cc:407] Connection header received
0812 11:25:02.996336 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:02.996339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:02.996386 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:02.996454 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:02.997273 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.997785 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.998894 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.999118 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.999206 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.000130 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:03.000133 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:03.000135 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:03.000146 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:03.000165 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:03.000172 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:03.000229 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.000367 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.000425 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:25:03.000840 12991 external_mini_cluster.cc:1428] Setting key 44412c4d222b4415492c34877d4cbb9a
I20260812 11:25:03.001405 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:02.994283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38713 (local address 127.12.175.194:36163)
0812 11:25:02.994877 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:02.994913 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:02.996135 (+ 1222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:02.996596 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:02.996603 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:02.996680 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:02.997161 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.997174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.997918 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.997921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.998774 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:02.998784 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:02.999253 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:02.999257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:02.999431 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:02.999893 (+ 462us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:25:02.999895 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:02.999929 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:25:02.999987 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:03.000239 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:03.000248 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:03.000254 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.000357 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.000624 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":105,"threads_started":1}
I20260812 11:25:03.002432 19608 heartbeater.cc:347] Connected to a master server at 127.12.175.254:38713
I20260812 11:25:03.002637 19608 heartbeater.cc:464] Registering TS with master...
I20260812 11:25:03.002784 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.175.195:0
--local_ip_for_outbound_sockets=127.12.175.195
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38713
--builtin_ntp_servers=127.12.175.212:34065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:25:03.003115 19608 heartbeater.cc:511] Master 127.12.175.254:38713 requested a full tablet report, sending...
I20260812 11:25:03.004103 18994 ts_manager.cc:194] Registered new tserver with Master: 0a24e838ce06404fa8ff3b1b7c27533e (127.12.175.194:43919)
I20260812 11:25:03.004731 18994 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.194:36163
W20260812 11:25:03.109479 19612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:03.109719 19612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:03.109758 19612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:03.113686 19612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:03.113732 19612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:03.113793 19612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.175.195
I20260812 11:25:03.118252 19612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:34065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.175.195
--webserver_port=0
--tserver_master_addrs=127.12.175.254:38713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.175.195
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:03.119148 19612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:03.120373 19612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:03.129101 19626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:03.129096 19622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:03.129264 19612 server_base.cc:1034] running on GCE node
W20260812 11:25:03.129123 19629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:03.129699 19612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:03.130237 19612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:03.131386 19612 hybrid_clock.cc:648] HybridClock initialized: now 1786533903131369 us; error 27 us; skew 500 ppm
I20260812 11:25:03.139806 19612 webserver.cc:460] Webserver started at http://127.12.175.195:43701/ using document root <none> and password file <none>
I20260812 11:25:03.140302 19612 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:03.140360 19612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:03.140556 19612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:03.142408 19612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data/instance:
uuid: "ad8542ad4401435fbb4877a74f9ae570"
format_stamp: "Formatted at 2026-08-12 11:25:03 on dist-test-slave-gjrz"
server_key: "2d28b35f47e1ed93df9cfdae149ca2fb"
server_key_iv: "0c546b4b8980ecde6bb2be2fdabe976c"
server_key_version: "encryptionkey@0"
I20260812 11:25:03.142918 19612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance:
uuid: "ad8542ad4401435fbb4877a74f9ae570"
format_stamp: "Formatted at 2026-08-12 11:25:03 on dist-test-slave-gjrz"
server_key: "2d28b35f47e1ed93df9cfdae149ca2fb"
server_key_iv: "0c546b4b8980ecde6bb2be2fdabe976c"
server_key_version: "encryptionkey@0"
I20260812 11:25:03.146443 19612 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:25:03.148820 19635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:03.149916 19612 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:25:03.150012 19612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal
uuid: "ad8542ad4401435fbb4877a74f9ae570"
format_stamp: "Formatted at 2026-08-12 11:25:03 on dist-test-slave-gjrz"
server_key: "2d28b35f47e1ed93df9cfdae149ca2fb"
server_key_iv: "0c546b4b8980ecde6bb2be2fdabe976c"
server_key_version: "encryptionkey@0"
I20260812 11:25:03.150106 19612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:03.172742 19612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:03.173273 19612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:03.173424 19612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:03.173918 19612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:25:03.174742 19612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:25:03.174786 19612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:03.174827 19612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:25:03.174856 19612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:03.182696 19612 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.195:35949
I20260812 11:25:03.182722 19871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.195:35949 every 8 connection(s)
I20260812 11:25:03.183503 19612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/data/info.pb
I20260812 11:25:03.189739 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19612
I20260812 11:25:03.189845 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal/instance
I20260812 11:25:03.190140 12991 external_mini_cluster.cc:1428] Setting key 070299756dcbc7b9f5b6d7843eb688d1
I20260812 11:25:03.191962 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.185094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:46897 (local address 127.12.175.254:38713)
0812 11:25:03.185230 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.185234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.186169 (+ 935us) server_negotiation.cc:407] Connection header received
0812 11:25:03.187458 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.187461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.187505 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.187574 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:03.188412 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.188926 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.190202 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.190441 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.190545 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.191523 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:03.191526 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:03.191534 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:03.191545 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:03.191564 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:03.191571 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:03.191627 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.191763 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.191820 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:25:03.192793 19875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.185455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:38713 (local address 127.12.175.195:46897)
0812 11:25:03.186053 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.186088 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:03.187286 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:03.187708 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:03.187714 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:03.187805 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:03.188279 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.188292 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.189014 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.189016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.190087 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.190098 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.190584 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.190589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.190745 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.191238 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:25:03.191240 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:03.191317 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:25:03.191378 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:03.191637 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:03.191646 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:03.191652 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.191756 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.192000 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":116,"threads_started":1}
I20260812 11:25:03.193696 19872 heartbeater.cc:347] Connected to a master server at 127.12.175.254:38713
I20260812 11:25:03.193888 19872 heartbeater.cc:464] Registering TS with master...
I20260812 11:25:03.194319 19872 heartbeater.cc:511] Master 127.12.175.254:38713 requested a full tablet report, sending...
I20260812 11:25:03.195204 18994 ts_manager.cc:194] Registered new tserver with Master: ad8542ad4401435fbb4877a74f9ae570 (127.12.175.195:35949)
I20260812 11:25:03.195755 18994 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.175.195:46897
I20260812 11:25:03.203838 12991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:25:03.209012 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.205638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35844 (local address 127.12.175.254:38713)
0812 11:25:03.205745 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.205748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.205892 (+ 144us) server_negotiation.cc:407] Connection header received
0812 11:25:03.206020 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.206022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.206062 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.206119 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:03.206383 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.206861 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.207714 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.207915 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.207995 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.208636 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:03.208639 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:03.208641 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:03.208651 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:03.208667 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:03.208674 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:03.208729 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.208818 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.208888 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:25:03.211402 18994 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:25:03.214159 18994 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:25:03.227596 19899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.221862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.195:35949 (local address 127.0.0.1:54894)
0812 11:25:03.222817 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.222863 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:03.223007 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:03.223519 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:03.223525 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:03.223547 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:03.223656 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.223664 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.224931 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.224934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.226122 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.226134 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.227110 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.227114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.227218 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.227253 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.227378 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.227470 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":29,"spinlock_wait_cycles":507136,"thread_start_us":96,"threads_started":1}
I20260812 11:25:03.227864 19894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.221740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47758 (local address 127.12.175.193:41591)
0812 11:25:03.222821 (+ 1081us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.222835 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.223153 (+ 318us) server_negotiation.cc:407] Connection header received
0812 11:25:03.223236 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.223240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.223422 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.223572 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:03.223935 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.225027 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.226502 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.227010 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.227132 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.227317 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.227596 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.227700 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":987,"thread_start_us":151,"threads_started":1}
I20260812 11:25:03.227869 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.222011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.12.175.195:35949)
0812 11:25:03.222290 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.222300 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.222999 (+ 699us) server_negotiation.cc:407] Connection header received
0812 11:25:03.223148 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.223153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.223360 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.223511 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:03.223749 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.224807 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.226229 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.226981 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.227106 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.227290 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.227430 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.227517 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
I20260812 11:25:03.227926 19893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.221594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:41591 (local address 127.0.0.1:47758)
0812 11:25:03.222817 (+ 1223us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.222865 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:03.223132 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:03.223711 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:03.223713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:03.223730 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:03.223817 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.223823 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.225142 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.225145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.226396 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.226404 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.227365 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.227369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.227456 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.227479 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.227560 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.227626 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":209,"spinlock_wait_cycles":4608,"thread_start_us":75,"threads_started":1}
I20260812 11:25:03.228578 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.222406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59530 (local address 127.12.175.194:43919)
0812 11:25:03.223099 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.223109 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.223129 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:25:03.223191 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.223195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.223367 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.223511 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:03.223961 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.224700 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.226185 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.226981 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.227105 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.227288 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.228188 (+ 900us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.228419 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":116,"threads_started":1}
I20260812 11:25:03.229223 19896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.222268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:43919 (local address 127.0.0.1:59530)
0812 11:25:03.222901 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.222912 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:03.223007 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:03.223770 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:03.223773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:03.223786 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:03.223866 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.223872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.224815 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.224818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.226066 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.226076 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.227743 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.227746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.227840 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.227864 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.227933 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.228008 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":206,"spinlock_wait_cycles":542336,"thread_start_us":85,"threads_started":1}
I20260812 11:25:03.230543 19742 tablet_service.cc:1467] Processing CreateTablet for tablet 37040d30185e4a518e6521169ebead85 (DEFAULT_TABLE table=test-table [id=a959cdf22fc94c44b69854fd12226480]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:25:03.230603 19210 tablet_service.cc:1467] Processing CreateTablet for tablet 37040d30185e4a518e6521169ebead85 (DEFAULT_TABLE table=test-table [id=a959cdf22fc94c44b69854fd12226480]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:25:03.231470 19742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37040d30185e4a518e6521169ebead85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:03.231626 19210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37040d30185e4a518e6521169ebead85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:03.231649 19478 tablet_service.cc:1467] Processing CreateTablet for tablet 37040d30185e4a518e6521169ebead85 (DEFAULT_TABLE table=test-table [id=a959cdf22fc94c44b69854fd12226480]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:25:03.232556 19478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37040d30185e4a518e6521169ebead85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:03.237219 19902 tablet_bootstrap.cc:492] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Bootstrap starting.
I20260812 11:25:03.238904 19907 tablet_bootstrap.cc:492] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Bootstrap starting.
I20260812 11:25:03.239387 19902 tablet_bootstrap.cc:654] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:03.239379 19905 tablet_bootstrap.cc:492] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: Bootstrap starting.
I20260812 11:25:03.240398 19902 log.cc:824] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:03.240983 19907 tablet_bootstrap.cc:654] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:03.241149 19905 tablet_bootstrap.cc:654] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:03.241731 19907 log.cc:824] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:03.241860 19905 log.cc:824] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:03.242738 19902 tablet_bootstrap.cc:492] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: No bootstrap required, opened a new log
I20260812 11:25:03.242909 19902 ts_tablet_manager.cc:1397] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260812 11:25:03.243636 19907 tablet_bootstrap.cc:492] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: No bootstrap required, opened a new log
I20260812 11:25:03.243685 19905 tablet_bootstrap.cc:492] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: No bootstrap required, opened a new log
I20260812 11:25:03.243817 19905 ts_tablet_manager.cc:1397] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:25:03.243818 19907 ts_tablet_manager.cc:1397] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:25:03.246196 19902 raft_consensus.cc:348] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.246538 19902 raft_consensus.cc:374] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:03.246608 19902 raft_consensus.cc:729] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8542ad4401435fbb4877a74f9ae570, State: Initialized, Role: FOLLOWER
I20260812 11:25:03.247025 19902 consensus_queue.cc:260] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.247594 19872 heartbeater.cc:503] Master 127.12.175.254:38713 was elected leader, sending a full tablet report...
I20260812 11:25:03.247948 19902 ts_tablet_manager.cc:1428] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260812 11:25:03.247860 19907 raft_consensus.cc:348] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.247860 19905 raft_consensus.cc:348] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.248091 19905 raft_consensus.cc:374] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:03.248131 19907 raft_consensus.cc:374] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:03.248178 19905 raft_consensus.cc:729] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f94ea4e10504d3ea8e54fa558c1eb39, State: Initialized, Role: FOLLOWER
I20260812 11:25:03.248208 19907 raft_consensus.cc:729] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a24e838ce06404fa8ff3b1b7c27533e, State: Initialized, Role: FOLLOWER
I20260812 11:25:03.248624 19907 consensus_queue.cc:260] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.248623 19905 consensus_queue.cc:260] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.249416 19340 heartbeater.cc:503] Master 127.12.175.254:38713 was elected leader, sending a full tablet report...
I20260812 11:25:03.249519 19905 ts_tablet_manager.cc:1428] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:25:03.249519 19907 ts_tablet_manager.cc:1428] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:25:03.250403 19608 heartbeater.cc:503] Master 127.12.175.254:38713 was elected leader, sending a full tablet report...
I20260812 11:25:03.254172 19918 raft_consensus.cc:482] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:25:03.254293 19918 raft_consensus.cc:504] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.255144 19918 leader_election.cc:288] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f94ea4e10504d3ea8e54fa558c1eb39 (127.12.175.193:41591), 0a24e838ce06404fa8ff3b1b7c27533e (127.12.175.194:43919)
I20260812 11:25:03.258620 19875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.255333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:41591 (local address 127.12.175.195:38297)
0812 11:25:03.255434 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.255448 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:03.255523 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:03.255800 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:03.255803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:03.255819 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:03.255905 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.255910 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.256737 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.256740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.257579 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.257589 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.258256 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.258260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.258353 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.258378 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.258443 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.258509 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":4}
I20260812 11:25:03.258651 19894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.255379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:38297 (local address 127.12.175.193:41591)
0812 11:25:03.255485 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.255489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.255502 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:25:03.255602 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.255605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.255645 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.255697 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:03.256021 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.256636 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.257690 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.258151 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.258235 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.258267 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.258463 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.258527 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:25:03.258800 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.255648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.175.195:56435 (local address 127.12.175.194:43919)
0812 11:25:03.255769 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.255773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.255946 (+ 173us) server_negotiation.cc:407] Connection header received
0812 11:25:03.256045 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.256048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.256083 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.256134 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:25:03.256365 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.256871 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.257900 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.258298 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.258402 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.258445 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.258632 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.258700 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:25:03.258915 19925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.255564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.194:43919 (local address 127.12.175.195:56435)
0812 11:25:03.255871 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.255881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:03.255962 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:03.256155 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:03.256158 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:03.256175 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:25:03.256282 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.256288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.256964 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.256967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.257781 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:03.257791 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.258414 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.258417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:03.258511 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.258534 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:25:03.258608 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:25:03.258668 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":22,"thread_start_us":94,"threads_started":1}
I20260812 11:25:03.259109 19244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37040d30185e4a518e6521169ebead85" candidate_uuid: "ad8542ad4401435fbb4877a74f9ae570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" is_pre_election: true
I20260812 11:25:03.259398 19244 raft_consensus.cc:2454] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8542ad4401435fbb4877a74f9ae570 in term 0.
I20260812 11:25:03.259424 19521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37040d30185e4a518e6521169ebead85" candidate_uuid: "ad8542ad4401435fbb4877a74f9ae570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" is_pre_election: true
I20260812 11:25:03.259629 19521 raft_consensus.cc:2454] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8542ad4401435fbb4877a74f9ae570 in term 0.
I20260812 11:25:03.259899 19648 leader_election.cc:302] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f94ea4e10504d3ea8e54fa558c1eb39, ad8542ad4401435fbb4877a74f9ae570; no voters:
I20260812 11:25:03.260149 19918 raft_consensus.cc:2781] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:25:03.260253 19918 raft_consensus.cc:482] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:25:03.260296 19918 raft_consensus.cc:3037] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:03.261147 19918 raft_consensus.cc:504] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.261459 19918 leader_election.cc:288] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [CANDIDATE]: Term 1 election: Requested vote from peers 6f94ea4e10504d3ea8e54fa558c1eb39 (127.12.175.193:41591), 0a24e838ce06404fa8ff3b1b7c27533e (127.12.175.194:43919)
I20260812 11:25:03.261699 19244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37040d30185e4a518e6521169ebead85" candidate_uuid: "ad8542ad4401435fbb4877a74f9ae570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39"
I20260812 11:25:03.261787 19521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37040d30185e4a518e6521169ebead85" candidate_uuid: "ad8542ad4401435fbb4877a74f9ae570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a24e838ce06404fa8ff3b1b7c27533e"
I20260812 11:25:03.261802 19244 raft_consensus.cc:3037] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:03.261906 19521 raft_consensus.cc:3037] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:03.262678 19244 raft_consensus.cc:2454] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8542ad4401435fbb4877a74f9ae570 in term 1.
I20260812 11:25:03.262748 19521 raft_consensus.cc:2454] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8542ad4401435fbb4877a74f9ae570 in term 1.
I20260812 11:25:03.262931 19648 leader_election.cc:302] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f94ea4e10504d3ea8e54fa558c1eb39, ad8542ad4401435fbb4877a74f9ae570; no voters:
I20260812 11:25:03.263087 19918 raft_consensus.cc:2781] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:03.263295 19918 raft_consensus.cc:686] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 1 LEADER]: Becoming Leader. State: Replica: ad8542ad4401435fbb4877a74f9ae570, State: Running, Role: LEADER
I20260812 11:25:03.263566 19918 consensus_queue.cc:237] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } }
I20260812 11:25:03.266140 18995 catalog_manager.cc:5495] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad8542ad4401435fbb4877a74f9ae570 (127.12.175.195). New cstate: current_term: 1 leader_uuid: "ad8542ad4401435fbb4877a74f9ae570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad8542ad4401435fbb4877a74f9ae570" member_type: VOTER last_known_addr { host: "127.12.175.195" port: 35949 } health_report { overall_health: HEALTHY } } }
I20260812 11:25:03.278100 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.274987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54908 (local address 127.12.175.195:35949)
0812 11:25:03.275094 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:03.275097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:03.275119 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:25:03.275275 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:03.275278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:03.275323 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:03.275402 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:03.275622 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.276071 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.276873 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:03.277076 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:03.277159 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:03.277420 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:03.277755 (+ 335us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:03.277854 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:03.277926 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:25:03.277971 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:25:03.282949 19244 raft_consensus.cc:1261] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39 [term 1 FOLLOWER]: Refusing update from remote peer ad8542ad4401435fbb4877a74f9ae570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:03.282951 19521 raft_consensus.cc:1261] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 1 FOLLOWER]: Refusing update from remote peer ad8542ad4401435fbb4877a74f9ae570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:03.283574 19927 consensus_queue.cc:1035] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a24e838ce06404fa8ff3b1b7c27533e" member_type: VOTER last_known_addr { host: "127.12.175.194" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:03.283748 19918 consensus_queue.cc:1035] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f94ea4e10504d3ea8e54fa558c1eb39" member_type: VOTER last_known_addr { host: "127.12.175.193" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:03.290350 19931 mvcc.cc:205] Tried to move back new op lower bound from 7317642867840811008 to 7317642867769720832. Current Snapshot: MvccSnapshot[applied={T|T < 7317642867840811008}]
I20260812 11:25:03.290526 19934 mvcc.cc:205] Tried to move back new op lower bound from 7317642867840811008 to 7317642867769720832. Current Snapshot: MvccSnapshot[applied={T|T < 7317642867840811008}]
I20260812 11:25:03.298532 18995 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:25:03.298664 18995 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:25:03.300983 18995 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0c02b3888274e0386361cff86f2fc05: Sending DeleteTablet for 3 replicas of tablet 37040d30185e4a518e6521169ebead85
I20260812 11:25:03.301651 19742 tablet_service.cc:1514] Processing DeleteTablet for tablet 37040d30185e4a518e6521169ebead85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:25:03 UTC) from {username='slave'} at 127.0.0.1:54894
I20260812 11:25:03.301684 19478 tablet_service.cc:1514] Processing DeleteTablet for tablet 37040d30185e4a518e6521169ebead85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:25:03 UTC) from {username='slave'} at 127.0.0.1:59530
I20260812 11:25:03.301687 19210 tablet_service.cc:1514] Processing DeleteTablet for tablet 37040d30185e4a518e6521169ebead85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:25:03 UTC) from {username='slave'} at 127.0.0.1:47758
I20260812 11:25:03.302114 19949 tablet_replica.cc:330] T 37040d30185e4a518e6521169ebead85 P 6f94ea4e10504d3ea8e54fa558c1eb39: stopping tablet replica
I20260812 11:25:03.302208 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19106
I20260812 11:25:03.311327 19946 tablet_replica.cc:330] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: stopping tablet replica
I20260812 11:25:03.311583 19948 tablet_replica.cc:330] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: stopping tablet replica
I20260812 11:25:03.311969 19948 raft_consensus.cc:2229] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:25:03.312290 19946 raft_consensus.cc:2229] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:25:03.312721 19946 raft_consensus.cc:2258] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:25:03.313060 19948 raft_consensus.cc:2258] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:25:03.314743 19948 ts_tablet_manager.cc:1905] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:25:03.317443 19948 ts_tablet_manager.cc:1918] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:25:03.317551 19948 log.cc:1196] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-1/wal/wals/37040d30185e4a518e6521169ebead85
I20260812 11:25:03.317847 19948 ts_tablet_manager.cc:1939] T 37040d30185e4a518e6521169ebead85 P 0a24e838ce06404fa8ff3b1b7c27533e: Deleting consensus metadata
I20260812 11:25:03.318742 19946 ts_tablet_manager.cc:1905] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:25:03.319015 18977 catalog_manager.cc:4841] TS 0a24e838ce06404fa8ff3b1b7c27533e (127.12.175.194:43919): tablet 37040d30185e4a518e6521169ebead85 (table test-table [id=a959cdf22fc94c44b69854fd12226480]) successfully deleted
I20260812 11:25:03.321435 19946 ts_tablet_manager.cc:1918] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:25:03.321586 19946 log.cc:1196] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Deleting WAL directory at /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533654564615-12991-0/minicluster-data/ts-2/wal/wals/37040d30185e4a518e6521169ebead85
W20260812 11:25:03.321794 18977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.175.193:41591 (error 108)
I20260812 11:25:03.321982 19946 ts_tablet_manager.cc:1939] T 37040d30185e4a518e6521169ebead85 P ad8542ad4401435fbb4877a74f9ae570: Deleting consensus metadata
I20260812 11:25:03.322836 19896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:03.322500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.193:41591 (local address 127.0.0.1:47772)
0812 11:25:03.322686 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:03.322755 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 11:25:03.323015 18976 catalog_manager.cc:4841] TS ad8542ad4401435fbb4877a74f9ae570 (127.12.175.195:35949): tablet 37040d30185e4a518e6521169ebead85 (table test-table [id=a959cdf22fc94c44b69854fd12226480]) successfully deleted
W20260812 11:25:03.323030 18977 catalog_manager.cc:4584] TS 6f94ea4e10504d3ea8e54fa558c1eb39 (127.12.175.193:41591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37040d30185e4a518e6521169ebead85: Network error: Client connection negotiation failed: client connection to 127.12.175.193:41591: connect: Connection refused (error 111)
I20260812 11:25:03.323369 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19343
I20260812 11:25:03.358016 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19612
I20260812 11:25:03.371402 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 18941
2026-08-12T11:25:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (984 ms)
[----------] 6 tests from EncryptionPolicyTest (10406 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:03 dist-test-slave-gjrz krb5kdc[19956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:03 dist-test-slave-gjrz krb5kdc[19956](info): set up 2 sockets
Aug 12 11:25:03 dist-test-slave-gjrz krb5kdc[19956](info): commencing operation
krb5kdc: starting...
W20260812 11:25:04.554921 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:04 dist-test-slave-gjrz krb5kdc[19956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:04.666880 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:04.772534 19972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:04.772755 19972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:04.772810 19972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:04.776665 19972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:04.776714 19972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:04.776741 19972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:04.776762 19972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:04.776786 19972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:04.781693 19972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41649
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:04.782553 19972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:04.783453 19972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:04.791044 19984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:04.791052 19986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:04.791080 19981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:04.791440 19972 server_base.cc:1034] running on GCE node
I20260812 11:25:04.791919 19972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:04.792891 19972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:04.794088 19972 hybrid_clock.cc:648] HybridClock initialized: now 1786533904794075 us; error 27 us; skew 500 ppm
Aug 12 11:25:04 dist-test-slave-gjrz krb5kdc[19956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533904, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:04.796635 19972 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:04.797469 19972 webserver.cc:460] Webserver started at http://127.0.0.1:39233/ using document root <none> and password file <none>
I20260812 11:25:04.798110 19972 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:04.798200 19972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:04.798435 19972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:04.800359 19972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "6d3d57257fea448cbdbfa389dbf30c1e"
format_stamp: "Formatted at 2026-08-12 11:25:04 on dist-test-slave-gjrz"
server_key: "337ca00f957aef70b9f9061dcdce2761"
server_key_iv: "db9f35655cd44d9079024f2ba840bed4"
server_key_version: "encryptionkey@0"
I20260812 11:25:04.800830 19972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "6d3d57257fea448cbdbfa389dbf30c1e"
format_stamp: "Formatted at 2026-08-12 11:25:04 on dist-test-slave-gjrz"
server_key: "337ca00f957aef70b9f9061dcdce2761"
server_key_iv: "db9f35655cd44d9079024f2ba840bed4"
server_key_version: "encryptionkey@0"
I20260812 11:25:04.804237 19972 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:04.806380 19997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:04.807524 19972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:25:04.807638 19972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "6d3d57257fea448cbdbfa389dbf30c1e"
format_stamp: "Formatted at 2026-08-12 11:25:04 on dist-test-slave-gjrz"
server_key: "337ca00f957aef70b9f9061dcdce2761"
server_key_iv: "db9f35655cd44d9079024f2ba840bed4"
server_key_version: "encryptionkey@0"
I20260812 11:25:04.807726 19972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:04.825858 19972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:04.828299 19972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:04.828462 19972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:04.834913 19972 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41649
I20260812 11:25:04.834932 20091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41649 every 8 connection(s)
I20260812 11:25:04.835753 19972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:04.838292 20094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:04.841924 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 19972
I20260812 11:25:04.842063 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:04.842361 12991 external_mini_cluster.cc:1428] Setting key 19568a25bf50c55a93d32c37e7e40d4b
I20260812 11:25:04.843822 20094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e: Bootstrap starting.
I20260812 11:25:04.846065 20094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:04.846750 20094 log.cc:824] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:04.848407 20094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e: No bootstrap required, opened a new log
Aug 12 11:25:04 dist-test-slave-gjrz krb5kdc[19956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:25:04.852519 20094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41649 } }
I20260812 11:25:04.852766 20094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:04.852833 20094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d3d57257fea448cbdbfa389dbf30c1e, State: Initialized, Role: FOLLOWER
I20260812 11:25:04.853302 20094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41649 } }
I20260812 11:25:04.853440 20094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:04.853528 20094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:04.853631 20094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:04.854561 20094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41649 } }
I20260812 11:25:04.854903 20094 leader_election.cc:302] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d3d57257fea448cbdbfa389dbf30c1e; no voters:
I20260812 11:25:04.855222 20094 leader_election.cc:288] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:04.855340 20101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:04.855568 20101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [term 1 LEADER]: Becoming Leader. State: Replica: 6d3d57257fea448cbdbfa389dbf30c1e, State: Running, Role: LEADER
I20260812 11:25:04.856231 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:04.843618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35669 (local address 127.0.0.1:41649)
0812 11:25:04.843999 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:04.844014 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:04.844047 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:25:04.844646 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:04.844661 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:04.844971 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:04.845229 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:04.846081 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:04.847089 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:04.847981 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:04.848435 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:04.848581 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:04.851241 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:04.851248 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:04.851285 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:04.851316 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:04.853094 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:04.853564 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:04.853571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:04.853577 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:04.853716 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:04.854052 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:04.854056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:04.854058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:04.854543 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:04.854760 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:04.854996 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 11:25:04.855212 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":108,"threads_started":1}
I20260812 11:25:04.856379 20094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:04.857227 20101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41649 } }
I20260812 11:25:04.858883 20102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41649 } } }
I20260812 11:25:04.859000 20102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:04.858968 20103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d3d57257fea448cbdbfa389dbf30c1e. Latest consensus state: current_term: 1 leader_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d3d57257fea448cbdbfa389dbf30c1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41649 } } }
I20260812 11:25:04.859071 20103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:04.859447 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 11:25:04.861478 20130 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:04.861595 20130 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:04.861694 20132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:04.862394 20132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:04.867492 20132 catalog_manager.cc:1347] Generated new cluster ID: fcd702b1334a4881a1b140648b89c9da
I20260812 11:25:04.867549 20132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:04.871182 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:04.861373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34137 (local address 127.0.0.1:41649)
0812 11:25:04.861467 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:04.861471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:04.863325 (+ 1854us) server_negotiation.cc:407] Connection header received
0812 11:25:04.863366 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:04.863368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:04.863413 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:04.863499 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:04.864263 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:04.864987 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:04.866107 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:04.866425 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:04.866537 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:04.868062 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:04.868066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:04.868068 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:04.868093 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:04.869551 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:04.870057 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:04.870060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:04.870061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:04.870130 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:04.870426 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:04.870429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:04.870431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:04.870594 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:04.870707 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:04.870966 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 11:25:04.871046 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:25:04.887622 20132 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:04.888443 20132 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:04.893556 20132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d3d57257fea448cbdbfa389dbf30c1e: Generated new TSK 0
I20260812 11:25:04.894102 20132 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:04.901216 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 19972
W20260812 11:25:04.926438 19953 connection.cc:535] client connection to 127.0.0.1:41649 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41649): Connection reset by peer (error 104)
2026-08-12T11:25:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1545 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:04 dist-test-slave-gjrz krb5kdc[20151](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:04 dist-test-slave-gjrz krb5kdc[20151](info): set up 2 sockets
Aug 12 11:25:04 dist-test-slave-gjrz krb5kdc[20151](info): commencing operation
krb5kdc: starting...
W20260812 11:25:06.106103 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:06 dist-test-slave-gjrz krb5kdc[20151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:06.219208 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43521
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:06.325291 20181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:06.325511 20181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:06.325549 20181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:06.329334 20181 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:06.329377 20181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:06.329394 20181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:06.329411 20181 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:06.329427 20181 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:06.334318 20181 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43521
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:06.335127 20181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:06.335979 20181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:06.343888 20189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:06.344064 20181 server_base.cc:1034] running on GCE node
W20260812 11:25:06.343900 20187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:06.343948 20191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:06.344707 20181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:06.345630 20181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:06.346782 20181 hybrid_clock.cc:648] HybridClock initialized: now 1786533906346762 us; error 29 us; skew 500 ppm
Aug 12 11:25:06 dist-test-slave-gjrz krb5kdc[20151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533906, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:06.349259 20181 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:06.350059 20181 webserver.cc:460] Webserver started at http://127.0.0.1:42895/ using document root <none> and password file <none>
I20260812 11:25:06.350543 20181 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:06.350608 20181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:06.350790 20181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:06.352653 20181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "ed8ae65194d84d8184c66b6c8bdc0db3"
format_stamp: "Formatted at 2026-08-12 11:25:06 on dist-test-slave-gjrz"
server_key: "8811b1d6a5c2f59d3fd6d0c6ff9c7f4f"
server_key_iv: "4950f744eb41f3a95a6eb7eb315a8079"
server_key_version: "encryptionkey@0"
I20260812 11:25:06.353181 20181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "ed8ae65194d84d8184c66b6c8bdc0db3"
format_stamp: "Formatted at 2026-08-12 11:25:06 on dist-test-slave-gjrz"
server_key: "8811b1d6a5c2f59d3fd6d0c6ff9c7f4f"
server_key_iv: "4950f744eb41f3a95a6eb7eb315a8079"
server_key_version: "encryptionkey@0"
I20260812 11:25:06.356537 20181 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:06.358630 20203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:06.359762 20181 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:25:06.359870 20181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "ed8ae65194d84d8184c66b6c8bdc0db3"
format_stamp: "Formatted at 2026-08-12 11:25:06 on dist-test-slave-gjrz"
server_key: "8811b1d6a5c2f59d3fd6d0c6ff9c7f4f"
server_key_iv: "4950f744eb41f3a95a6eb7eb315a8079"
server_key_version: "encryptionkey@0"
I20260812 11:25:06.359956 20181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:06.393151 20181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:06.395762 20181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:06.395928 20181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:06.402310 20181 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43521
I20260812 11:25:06.402333 20297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43521 every 8 connection(s)
I20260812 11:25:06.403155 20181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:06.404387 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20181
I20260812 11:25:06.404521 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:06.404858 12991 external_mini_cluster.cc:1428] Setting key a23b9bfc8fe8dfb715fcfaecd5b65565
I20260812 11:25:06.406227 20298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:06.412674 20298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3: Bootstrap starting.
I20260812 11:25:06.414233 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:06.406078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42013 (local address 127.0.0.1:43521)
0812 11:25:06.406472 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:06.406490 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:06.406539 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:25:06.407416 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:06.407438 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:06.407841 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:06.408178 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:06.408559 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:06.409987 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:06.410807 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:06.411502 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:06.411676 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:06.412404 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:06.412410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:06.412425 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:06.412881 (+ 456us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:06.412947 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:06.412976 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:06.413101 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:06.413250 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:25:06.413370 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":121,"threads_started":1}
I20260812 11:25:06.415062 20298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:06.415903 20298 log.cc:824] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:06.416989 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:06.417806 20298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3: No bootstrap required, opened a new log
I20260812 11:25:06.421394 20298 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43521 } }
I20260812 11:25:06.421650 20298 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:06.421715 20298 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed8ae65194d84d8184c66b6c8bdc0db3, State: Initialized, Role: FOLLOWER
I20260812 11:25:06.422189 20298 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43521 } }
I20260812 11:25:06.422345 20298 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:06.422415 20298 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:06.422520 20298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:06.422986 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:06.419162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32939 (local address 127.0.0.1:43521)
0812 11:25:06.419283 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:06.419288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:06.419397 (+ 109us) server_negotiation.cc:407] Connection header received
0812 11:25:06.419511 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:06.419513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:06.419549 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:06.419609 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:06.419939 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:06.420396 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:06.421482 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:06.421730 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:06.421820 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:06.422567 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:06.422570 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:06.422572 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:06.422583 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:06.422610 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:06.422624 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:06.422698 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:06.422834 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:25:06.422868 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:25:06.423581 20298 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43521 } }
I20260812 11:25:06.423926 20298 leader_election.cc:302] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed8ae65194d84d8184c66b6c8bdc0db3; no voters:
I20260812 11:25:06.424237 20298 leader_election.cc:288] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:06.424324 20323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:06.424523 20323 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [term 1 LEADER]: Becoming Leader. State: Replica: ed8ae65194d84d8184c66b6c8bdc0db3, State: Running, Role: LEADER
I20260812 11:25:06.424858 20323 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43521 } }
I20260812 11:25:06.425287 20298 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:06.426309 20331 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed8ae65194d84d8184c66b6c8bdc0db3. Latest consensus state: current_term: 1 leader_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43521 } } }
I20260812 11:25:06.426410 20331 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:06.426681 20324 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed8ae65194d84d8184c66b6c8bdc0db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43521 } } }
I20260812 11:25:06.426771 20324 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:06.426852 20341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:06.429498 20341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:06.434788 20341 catalog_manager.cc:1347] Generated new cluster ID: d779abb866fe4eaaada52b83a1bf7690
I20260812 11:25:06.434835 20341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:06.449822 20341 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:06.451836 20341 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:06.460847 20341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed8ae65194d84d8184c66b6c8bdc0db3: Generated new TSK 0
I20260812 11:25:06.461385 20341 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:06.470850 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20181
W20260812 11:25:06.488135 20148 connection.cc:535] client connection to 127.0.0.1:43521 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43521): Connection reset by peer (error 104)
2026-08-12T11:25:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1562 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:06 dist-test-slave-gjrz krb5kdc[20362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:06 dist-test-slave-gjrz krb5kdc[20362](info): set up 2 sockets
Aug 12 11:25:06 dist-test-slave-gjrz krb5kdc[20362](info): commencing operation
krb5kdc: starting...
W20260812 11:25:07.669752 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:07 dist-test-slave-gjrz krb5kdc[20362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:07.790086 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33859
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:07.894614 20386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:07.894824 20386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:07.894863 20386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:07.898780 20386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:07.898835 20386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:07.898852 20386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:07.898867 20386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:07.898886 20386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:07.903868 20386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33859
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:07.904760 20386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:07.905645 20386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:07.913445 20394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:07.913496 20395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:07.913465 20386 server_base.cc:1034] running on GCE node
W20260812 11:25:07.913484 20401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:07.914192 20386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:07.915184 20386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:07.916332 20386 hybrid_clock.cc:648] HybridClock initialized: now 1786533907916318 us; error 27 us; skew 500 ppm
Aug 12 11:25:07 dist-test-slave-gjrz krb5kdc[20362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533907, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:07.918853 20386 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:07.919693 20386 webserver.cc:460] Webserver started at http://127.0.0.1:42387/ using document root <none> and password file <none>
I20260812 11:25:07.920195 20386 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:07.920257 20386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:07.920432 20386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:07.922313 20386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "6a1df267cc02483084cc9b3179966ad7"
format_stamp: "Formatted at 2026-08-12 11:25:07 on dist-test-slave-gjrz"
server_key: "86cae4ca150910eddcd4aa5ccb28327b"
server_key_iv: "5ecb8f01ea7affb4c16e292a0dfcee8e"
server_key_version: "encryptionkey@0"
I20260812 11:25:07.922825 20386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "6a1df267cc02483084cc9b3179966ad7"
format_stamp: "Formatted at 2026-08-12 11:25:07 on dist-test-slave-gjrz"
server_key: "86cae4ca150910eddcd4aa5ccb28327b"
server_key_iv: "5ecb8f01ea7affb4c16e292a0dfcee8e"
server_key_version: "encryptionkey@0"
I20260812 11:25:07.926292 20386 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:25:07.928603 20413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:07.929729 20386 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:25:07.929841 20386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "6a1df267cc02483084cc9b3179966ad7"
format_stamp: "Formatted at 2026-08-12 11:25:07 on dist-test-slave-gjrz"
server_key: "86cae4ca150910eddcd4aa5ccb28327b"
server_key_iv: "5ecb8f01ea7affb4c16e292a0dfcee8e"
server_key_version: "encryptionkey@0"
I20260812 11:25:07.929952 20386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:07.934294 20386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:07.936982 20386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:07.937137 20386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:07.943787 20386 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33859
I20260812 11:25:07.943840 20512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33859 every 8 connection(s)
I20260812 11:25:07.944655 20386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:07.944897 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20386
I20260812 11:25:07.945035 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:07.945387 12991 external_mini_cluster.cc:1428] Setting key ace0cee03f233ac7f6fe8076e1021851
I20260812 11:25:07.947962 20514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:07.950664 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:07.946670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44657 (local address 127.0.0.1:33859)
0812 11:25:07.947079 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:07.947098 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:07.947139 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:25:07.947971 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:07.947995 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:07.948349 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:07.948713 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:07.949342 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:07.949347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:07.949362 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:07.949373 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:07.949432 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:07.949461 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:07.949597 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:07.949665 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 11:25:07.949802 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":108,"threads_started":1}
I20260812 11:25:07.953207 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:07.954327 20514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7: Bootstrap starting.
I20260812 11:25:07.956652 20514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:07.956933 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:07.955464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42095 (local address 127.0.0.1:33859)
0812 11:25:07.955578 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:07.955592 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:07.955785 (+ 193us) server_negotiation.cc:407] Connection header received
0812 11:25:07.955886 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:07.955889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:07.955919 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:07.955979 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:07.956566 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:07.956570 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:07.956572 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:07.956591 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:07.956615 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:07.956625 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:07.956693 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:07.956798 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 11:25:07.956830 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:25:07.957464 20514 log.cc:824] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:07.959232 20514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7: No bootstrap required, opened a new log
I20260812 11:25:07.962505 20514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1df267cc02483084cc9b3179966ad7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33859 } }
I20260812 11:25:07.962709 20514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:07.962749 20514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a1df267cc02483084cc9b3179966ad7, State: Initialized, Role: FOLLOWER
I20260812 11:25:07.963086 20514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1df267cc02483084cc9b3179966ad7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33859 } }
I20260812 11:25:07.963201 20514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:07.963244 20514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:07.963351 20514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:07.964205 20514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1df267cc02483084cc9b3179966ad7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33859 } }
I20260812 11:25:07.964497 20514 leader_election.cc:302] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a1df267cc02483084cc9b3179966ad7; no voters:
I20260812 11:25:07.964727 20514 leader_election.cc:288] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:07.964821 20535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:07.965042 20535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [term 1 LEADER]: Becoming Leader. State: Replica: 6a1df267cc02483084cc9b3179966ad7, State: Running, Role: LEADER
I20260812 11:25:07.965370 20535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1df267cc02483084cc9b3179966ad7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33859 } }
I20260812 11:25:07.965781 20514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:07.966804 20540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a1df267cc02483084cc9b3179966ad7. Latest consensus state: current_term: 1 leader_uuid: "6a1df267cc02483084cc9b3179966ad7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1df267cc02483084cc9b3179966ad7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33859 } } }
I20260812 11:25:07.966914 20540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:07.967237 20539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a1df267cc02483084cc9b3179966ad7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1df267cc02483084cc9b3179966ad7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33859 } } }
I20260812 11:25:07.967401 20539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:07.967306 20556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:07.970924 20556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:07.976261 20556 catalog_manager.cc:1347] Generated new cluster ID: 176ae298f82049e0a0c34c6683b7dd6d
I20260812 11:25:07.976322 20556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:07.992522 20556 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:07.992789 20556 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:08.008077 20556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a1df267cc02483084cc9b3179966ad7: Generated new TSK 0
I20260812 11:25:08.008708 20556 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:08.016124 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20386
2026-08-12T11:25:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:08 dist-test-slave-gjrz krb5kdc[20578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:08 dist-test-slave-gjrz krb5kdc[20578](info): set up 2 sockets
Aug 12 11:25:08 dist-test-slave-gjrz krb5kdc[20578](info): commencing operation
krb5kdc: starting...
W20260812 11:25:09.203141 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:09 dist-test-slave-gjrz krb5kdc[20578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:09.318117 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33351
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:09.424881 20608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:09.425102 20608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:09.425145 20608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:09.429028 20608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:09.429078 20608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:09.429098 20608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:09.429128 20608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:09.429154 20608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:09.434073 20608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:09.434918 20608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:09.435845 20608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:09.443688 20621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:09.443733 20622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:09.443727 20625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:09.444154 20608 server_base.cc:1034] running on GCE node
I20260812 11:25:09.444612 20608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:09.445533 20608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:09.446684 20608 hybrid_clock.cc:648] HybridClock initialized: now 1786533909446671 us; error 23 us; skew 500 ppm
Aug 12 11:25:09 dist-test-slave-gjrz krb5kdc[20578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533909, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:09.453593 20608 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:09.454348 20608 webserver.cc:460] Webserver started at http://127.0.0.1:37357/ using document root <none> and password file <none>
I20260812 11:25:09.454833 20608 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:09.454890 20608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:09.455080 20608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:09.456954 20608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "ea59ffab728e4bbbaccc03c9f6b489eb"
format_stamp: "Formatted at 2026-08-12 11:25:09 on dist-test-slave-gjrz"
server_key: "9282f0b9869752ba3d6e8a3ad4ca6521"
server_key_iv: "810a111f30810d47ec972777df319d97"
server_key_version: "encryptionkey@0"
I20260812 11:25:09.457463 20608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "ea59ffab728e4bbbaccc03c9f6b489eb"
format_stamp: "Formatted at 2026-08-12 11:25:09 on dist-test-slave-gjrz"
server_key: "9282f0b9869752ba3d6e8a3ad4ca6521"
server_key_iv: "810a111f30810d47ec972777df319d97"
server_key_version: "encryptionkey@0"
I20260812 11:25:09.460886 20608 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 11:25:09.463003 20636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:09.464159 20608 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:09.464265 20608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "ea59ffab728e4bbbaccc03c9f6b489eb"
format_stamp: "Formatted at 2026-08-12 11:25:09 on dist-test-slave-gjrz"
server_key: "9282f0b9869752ba3d6e8a3ad4ca6521"
server_key_iv: "810a111f30810d47ec972777df319d97"
server_key_version: "encryptionkey@0"
I20260812 11:25:09.464354 20608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:09.478709 20608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:09.481045 20608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:09.481197 20608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:09.487449 20608 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33351
I20260812 11:25:09.487494 20733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33351 every 8 connection(s)
I20260812 11:25:09.488267 20608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:09.490840 20734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:09.493772 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20608
I20260812 11:25:09.493990 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:09.494524 12991 external_mini_cluster.cc:1428] Setting key b8a8da93acbd78901744a010fee04f0b
I20260812 11:25:09.497192 20734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb: Bootstrap starting.
I20260812 11:25:09.500015 20734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:09.500705 20734 log.cc:824] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:09.502388 20734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb: No bootstrap required, opened a new log
Aug 12 11:25:09 dist-test-slave-gjrz krb5kdc[20578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:25:09.506009 20734 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33351 } }
I20260812 11:25:09.506217 20734 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:09.506286 20734 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea59ffab728e4bbbaccc03c9f6b489eb, State: Initialized, Role: FOLLOWER
I20260812 11:25:09.506735 20734 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33351 } }
I20260812 11:25:09.506896 20734 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:09.506968 20734 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:09.507071 20734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:09.508129 20734 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33351 } }
I20260812 11:25:09.508483 20734 leader_election.cc:302] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea59ffab728e4bbbaccc03c9f6b489eb; no voters:
I20260812 11:25:09.508788 20734 leader_election.cc:288] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:09.508886 20747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:09.509084 20747 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [term 1 LEADER]: Becoming Leader. State: Replica: ea59ffab728e4bbbaccc03c9f6b489eb, State: Running, Role: LEADER
I20260812 11:25:09.509243 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:09.495923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41673 (local address 127.0.0.1:33351)
0812 11:25:09.496506 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:09.496524 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:09.496567 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:25:09.497370 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:09.497395 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:09.497818 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:09.498180 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:09.499297 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:09.500562 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:09.501423 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:09.501898 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:09.502057 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:09.504567 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:09.504572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:09.504583 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:09.504608 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:09.506111 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:09.506584 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:09.506590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:09.506596 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:09.506707 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:09.507046 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:09.507049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:09.507051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:09.507588 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:09.507784 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:09.508031 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 11:25:09.508321 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":122,"threads_started":1}
I20260812 11:25:09.509400 20747 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33351 } }
I20260812 11:25:09.509958 20734 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:09.510841 20750 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea59ffab728e4bbbaccc03c9f6b489eb. Latest consensus state: current_term: 1 leader_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33351 } } }
I20260812 11:25:09.510957 20750 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:09.511459 20749 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea59ffab728e4bbbaccc03c9f6b489eb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33351 } } }
I20260812 11:25:09.511551 20749 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:09.512869 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 11:25:09.514878 20788 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:09.514954 20788 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:09.515017 20772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:09.515775 20772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:09.521236 20772 catalog_manager.cc:1347] Generated new cluster ID: f3584ef363a44505a65b3fa207739769
I20260812 11:25:09.521298 20772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:09.522642 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:09.515709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47449 (local address 127.0.0.1:33351)
0812 11:25:09.515816 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:09.515820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:09.515981 (+ 161us) server_negotiation.cc:407] Connection header received
0812 11:25:09.516095 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:09.516097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:09.516132 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:09.516192 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:09.516911 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:09.517404 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:09.518217 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:09.518454 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:09.518539 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:09.519859 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:09.519862 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:09.519865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:09.519889 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:09.521174 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:09.521569 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:09.521573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:09.521574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:09.521646 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:09.521900 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:09.521903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:09.521905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:09.522068 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:09.522177 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:09.522410 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 11:25:09.522511 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:25:09.535943 20772 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:09.537012 20772 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:09.544756 20772 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea59ffab728e4bbbaccc03c9f6b489eb: Generated new TSK 0
I20260812 11:25:09.545399 20772 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:09.549434 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20608
2026-08-12T11:25:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:09 dist-test-slave-gjrz krb5kdc[20808](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:09 dist-test-slave-gjrz krb5kdc[20808](info): set up 2 sockets
Aug 12 11:25:09 dist-test-slave-gjrz krb5kdc[20808](info): commencing operation
krb5kdc: starting...
W20260812 11:25:10.739080 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:10 dist-test-slave-gjrz krb5kdc[20808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:10.851886 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39795
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:10.958362 20830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:10.958602 20830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:10.958657 20830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:10.962581 20830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:10.962636 20830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:10.962664 20830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:10.962685 20830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:10.962714 20830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:10.967695 20830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:10.968586 20830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:10.969482 20830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:10.977491 20847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:10.977531 20840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:10.977589 20843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:10.977646 20830 server_base.cc:1034] running on GCE node
I20260812 11:25:10.978219 20830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:10.979238 20830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:10.980419 20830 hybrid_clock.cc:648] HybridClock initialized: now 1786533910980402 us; error 27 us; skew 500 ppm
Aug 12 11:25:10 dist-test-slave-gjrz krb5kdc[20808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533910, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:10.982906 20830 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:10.983717 20830 webserver.cc:460] Webserver started at http://127.0.0.1:35069/ using document root <none> and password file <none>
I20260812 11:25:10.984203 20830 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:10.984267 20830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:10.984464 20830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:10.986323 20830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "fd0df634f7d948d78377ef132e0667f7"
format_stamp: "Formatted at 2026-08-12 11:25:10 on dist-test-slave-gjrz"
server_key: "c39f8e2ff7c7e0415912f123fd1faedd"
server_key_iv: "0be383e0438bda885c1c31a99c6b2cff"
server_key_version: "encryptionkey@0"
I20260812 11:25:10.986879 20830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "fd0df634f7d948d78377ef132e0667f7"
format_stamp: "Formatted at 2026-08-12 11:25:10 on dist-test-slave-gjrz"
server_key: "c39f8e2ff7c7e0415912f123fd1faedd"
server_key_iv: "0be383e0438bda885c1c31a99c6b2cff"
server_key_version: "encryptionkey@0"
I20260812 11:25:10.990260 20830 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:25:10.992440 20858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:10.993487 20830 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:25:10.993611 20830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "fd0df634f7d948d78377ef132e0667f7"
format_stamp: "Formatted at 2026-08-12 11:25:10 on dist-test-slave-gjrz"
server_key: "c39f8e2ff7c7e0415912f123fd1faedd"
server_key_iv: "0be383e0438bda885c1c31a99c6b2cff"
server_key_version: "encryptionkey@0"
I20260812 11:25:10.993698 20830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:11.020171 20830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:11.022776 20830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:11.022938 20830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:11.029292 20830 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39795
I20260812 11:25:11.029337 20968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39795 every 8 connection(s)
I20260812 11:25:11.030156 20830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:11.032800 20970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:11.037168 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 20830
I20260812 11:25:11.037305 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:11.037560 12991 external_mini_cluster.cc:1428] Setting key e9b5a405ddedca6b7338db09d73584f7
I20260812 11:25:11.038123 20970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7: Bootstrap starting.
I20260812 11:25:11.040443 20970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:11.041158 20970 log.cc:824] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:11.042891 20970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7: No bootstrap required, opened a new log
I20260812 11:25:11.045629 20975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:11.038761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34791 (local address 127.0.0.1:39795)
0812 11:25:11.039160 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:11.039174 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:11.039206 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:25:11.039833 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:11.039850 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:11.040162 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:11.040459 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:11.040871 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:11.041869 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:11.042733 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:11.043210 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:11.043389 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:11.044127 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:11.044132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:11.044144 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:11.044483 (+ 339us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:11.044538 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:11.044559 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:11.044652 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:11.044803 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 11:25:11.044987 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":116,"threads_started":1}
I20260812 11:25:11.046377 20970 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0df634f7d948d78377ef132e0667f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39795 } }
I20260812 11:25:11.046643 20970 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:11.046710 20970 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd0df634f7d948d78377ef132e0667f7, State: Initialized, Role: FOLLOWER
I20260812 11:25:11.047155 20970 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0df634f7d948d78377ef132e0667f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39795 } }
I20260812 11:25:11.047328 20970 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:11.047443 20970 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:11.047536 20970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:11.048257 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:11.048480 20970 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0df634f7d948d78377ef132e0667f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39795 } }
I20260812 11:25:11.048786 20970 leader_election.cc:302] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd0df634f7d948d78377ef132e0667f7; no voters:
I20260812 11:25:11.049090 20970 leader_election.cc:288] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:11.049146 20982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:11.049363 20982 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [term 1 LEADER]: Becoming Leader. State: Replica: fd0df634f7d948d78377ef132e0667f7, State: Running, Role: LEADER
I20260812 11:25:11.049662 20982 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0df634f7d948d78377ef132e0667f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39795 } }
I20260812 11:25:11.050307 20970 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:11.050787 20982 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd0df634f7d948d78377ef132e0667f7. Latest consensus state: current_term: 1 leader_uuid: "fd0df634f7d948d78377ef132e0667f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0df634f7d948d78377ef132e0667f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39795 } } }
I20260812 11:25:11.050953 20982 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:11.051190 20982 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd0df634f7d948d78377ef132e0667f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0df634f7d948d78377ef132e0667f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39795 } } }
I20260812 11:25:11.051348 20982 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:11.051662 21004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:11.054651 20975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:11.050156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60735 (local address 127.0.0.1:39795)
0812 11:25:11.050249 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:11.050253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:11.050484 (+ 231us) server_negotiation.cc:407] Connection header received
0812 11:25:11.050593 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:11.050596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:11.050636 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:11.050702 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:11.051061 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:11.051788 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:11.052869 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:11.053194 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:11.053298 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:11.054118 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:11.054136 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:11.054138 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:11.054152 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:11.054178 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:11.054190 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:11.054280 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:11.054424 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 11:25:11.054489 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:25:11.054705 21004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:11.060407 21004 catalog_manager.cc:1347] Generated new cluster ID: d60d10f4a3dd4557875bb20729a5b3ce
I20260812 11:25:11.060456 21004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:11.072445 21004 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:11.073275 21004 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:11.085816 21004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd0df634f7d948d78377ef132e0667f7: Generated new TSK 0
I20260812 11:25:11.086416 21004 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:11.095768 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 20830
2026-08-12T11:25:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1550 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:11 dist-test-slave-gjrz krb5kdc[21034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:11 dist-test-slave-gjrz krb5kdc[21034](info): set up 2 sockets
Aug 12 11:25:11 dist-test-slave-gjrz krb5kdc[21034](info): commencing operation
krb5kdc: starting...
W20260812 11:25:12.292949 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:12 dist-test-slave-gjrz krb5kdc[21034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:12.406438 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:12.512403 21060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:12.512622 21060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:12.512660 21060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:12.516453 21060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:12.516498 21060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:12.516516 21060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:12.516530 21060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:12.516542 21060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:12.521378 21060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:12.522212 21060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:12.523048 21060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:12.530853 21066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:12.530870 21069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:12.530853 21065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:12.531067 21060 server_base.cc:1034] running on GCE node
I20260812 11:25:12.531687 21060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:12.532651 21060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:12.533802 21060 hybrid_clock.cc:648] HybridClock initialized: now 1786533912533773 us; error 48 us; skew 500 ppm
Aug 12 11:25:12 dist-test-slave-gjrz krb5kdc[21034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533912, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:12.536446 21060 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:12.537266 21060 webserver.cc:460] Webserver started at http://127.0.0.1:45605/ using document root <none> and password file <none>
I20260812 11:25:12.537747 21060 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:12.537806 21060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:12.537992 21060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:12.539898 21060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "9a6de257f59c4042a630105876fb0fe9"
format_stamp: "Formatted at 2026-08-12 11:25:12 on dist-test-slave-gjrz"
server_key: "b4afb2732310063279daf2cd7fff1959"
server_key_iv: "b73906146118858177f66b396ef5d6bc"
server_key_version: "encryptionkey@0"
I20260812 11:25:12.540408 21060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "9a6de257f59c4042a630105876fb0fe9"
format_stamp: "Formatted at 2026-08-12 11:25:12 on dist-test-slave-gjrz"
server_key: "b4afb2732310063279daf2cd7fff1959"
server_key_iv: "b73906146118858177f66b396ef5d6bc"
server_key_version: "encryptionkey@0"
I20260812 11:25:12.543730 21060 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:12.546268 21079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:12.547763 21060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:25:12.547880 21060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "9a6de257f59c4042a630105876fb0fe9"
format_stamp: "Formatted at 2026-08-12 11:25:12 on dist-test-slave-gjrz"
server_key: "b4afb2732310063279daf2cd7fff1959"
server_key_iv: "b73906146118858177f66b396ef5d6bc"
server_key_version: "encryptionkey@0"
I20260812 11:25:12.547984 21060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:12.552119 21060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:12.554565 21060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:12.554713 21060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:12.561138 21060 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42265
I20260812 11:25:12.561192 21191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42265 every 8 connection(s)
I20260812 11:25:12.561961 21060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:12.564585 21193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:12.569672 21193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9: Bootstrap starting.
I20260812 11:25:12.571281 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21060
I20260812 11:25:12.571403 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:12.571660 12991 external_mini_cluster.cc:1428] Setting key 9e859859093a2c1853f0d8e755d53373
I20260812 11:25:12.572048 21193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:12.572839 21193 log.cc:824] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:12.574860 21193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9: No bootstrap required, opened a new log
I20260812 11:25:12.576488 21200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:12.572623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40235 (local address 127.0.0.1:42265)
0812 11:25:12.573087 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:12.573104 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:12.573148 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:25:12.573868 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:12.573892 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:12.574210 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:12.574554 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:12.575185 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:12.575191 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:12.575208 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:12.575220 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:12.575303 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:12.575332 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:12.575444 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:12.575518 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 11:25:12.575654 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":135,"threads_started":1}
I20260812 11:25:12.578896 21193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6de257f59c4042a630105876fb0fe9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 11:25:12.579128 21193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:12.579144 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:12.579200 21193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6de257f59c4042a630105876fb0fe9, State: Initialized, Role: FOLLOWER
I20260812 11:25:12.579648 21193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6de257f59c4042a630105876fb0fe9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 11:25:12.579804 21193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:12.579864 21193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:12.579974 21193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:12.580981 21193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6de257f59c4042a630105876fb0fe9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 11:25:12.581293 21193 leader_election.cc:302] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a6de257f59c4042a630105876fb0fe9; no voters:
I20260812 11:25:12.581614 21193 leader_election.cc:288] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:12.581686 21222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:12.581894 21222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6de257f59c4042a630105876fb0fe9, State: Running, Role: LEADER
I20260812 11:25:12.582223 21222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6de257f59c4042a630105876fb0fe9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 11:25:12.582804 21193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:12.583196 21200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:12.581405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33381 (local address 127.0.0.1:42265)
0812 11:25:12.581509 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:12.581514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:12.581742 (+ 228us) server_negotiation.cc:407] Connection header received
0812 11:25:12.581957 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:12.581961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:12.581993 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:12.582038 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:12.582777 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:12.582780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:12.582782 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:12.582795 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:12.582821 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:12.582835 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:12.582917 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:12.583059 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 11:25:12.583096 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:25:12.584440 21226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a6de257f59c4042a630105876fb0fe9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6de257f59c4042a630105876fb0fe9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } } }
I20260812 11:25:12.584573 21226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:12.584872 21227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a6de257f59c4042a630105876fb0fe9. Latest consensus state: current_term: 1 leader_uuid: "9a6de257f59c4042a630105876fb0fe9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6de257f59c4042a630105876fb0fe9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } } }
I20260812 11:25:12.585292 21227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9 [sys.catalog]: This master's current role is: LEADER
W20260812 11:25:12.587208 21252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:12.587298 21252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:12.587366 21245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:12.588183 21245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:12.592644 21245 catalog_manager.cc:1347] Generated new cluster ID: 723946daf9694aadb99e0717866f1842
I20260812 11:25:12.592702 21245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:12.617551 21245 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:12.617854 21245 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:12.628988 21245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a6de257f59c4042a630105876fb0fe9: Generated new TSK 0
I20260812 11:25:12.629679 21245 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:12.639575 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21060
2026-08-12T11:25:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1542 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:12 dist-test-slave-gjrz krb5kdc[21263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:12 dist-test-slave-gjrz krb5kdc[21263](info): set up 2 sockets
Aug 12 11:25:12 dist-test-slave-gjrz krb5kdc[21263](info): commencing operation
krb5kdc: starting...
W20260812 11:25:13.841661 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:13 dist-test-slave-gjrz krb5kdc[21263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:13.955974 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:14.060973 21286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:14.061192 21286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:14.061247 21286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:14.065081 21286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:14.065133 21286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:14.065160 21286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:14.065182 21286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:14.065210 21286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:14.070125 21286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:14.070977 21286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:14.071843 21286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:14.079357 21296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:14.079391 21302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:14.079407 21297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:14.079522 21286 server_base.cc:1034] running on GCE node
I20260812 11:25:14.080098 21286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:14.081036 21286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:14.082187 21286 hybrid_clock.cc:648] HybridClock initialized: now 1786533914082163 us; error 41 us; skew 500 ppm
Aug 12 11:25:14 dist-test-slave-gjrz krb5kdc[21263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533914, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:14.084803 21286 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:14.085553 21286 webserver.cc:460] Webserver started at http://127.0.0.1:35077/ using document root <none> and password file <none>
I20260812 11:25:14.086027 21286 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:14.086081 21286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:14.086232 21286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:14.088132 21286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "d042e7320c2541c99d1406fc07863d74"
format_stamp: "Formatted at 2026-08-12 11:25:14 on dist-test-slave-gjrz"
server_key: "53d797d3b6a05f4bc870fa6bfb104f59"
server_key_iv: "075cb0bf6afa52ff25b768b9a03eb0cb"
server_key_version: "encryptionkey@0"
I20260812 11:25:14.088652 21286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "d042e7320c2541c99d1406fc07863d74"
format_stamp: "Formatted at 2026-08-12 11:25:14 on dist-test-slave-gjrz"
server_key: "53d797d3b6a05f4bc870fa6bfb104f59"
server_key_iv: "075cb0bf6afa52ff25b768b9a03eb0cb"
server_key_version: "encryptionkey@0"
I20260812 11:25:14.092134 21286 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:25:14.094323 21316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:14.095534 21286 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:14.095654 21286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "d042e7320c2541c99d1406fc07863d74"
format_stamp: "Formatted at 2026-08-12 11:25:14 on dist-test-slave-gjrz"
server_key: "53d797d3b6a05f4bc870fa6bfb104f59"
server_key_iv: "075cb0bf6afa52ff25b768b9a03eb0cb"
server_key_version: "encryptionkey@0"
I20260812 11:25:14.095744 21286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:14.119465 21286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:14.122052 21286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:14.122212 21286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:14.128530 21286 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45987
I20260812 11:25:14.128567 21424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45987 every 8 connection(s)
I20260812 11:25:14.129364 21286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:14.130831 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21286
I20260812 11:25:14.130992 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:14.131361 12991 external_mini_cluster.cc:1428] Setting key 79fdbdf99c8a7561e25ad041d13a6573
I20260812 11:25:14.132462 21426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:14.138523 21426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74: Bootstrap starting.
Aug 12 11:25:14 dist-test-slave-gjrz krb5kdc[21263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:25:14.140846 21426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:14.141542 21426 log.cc:824] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:14.143253 21426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74: No bootstrap required, opened a new log
I20260812 11:25:14.144775 21432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:14.132628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:49355 (local address 127.0.0.1:45987)
0812 11:25:14.133008 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:14.133031 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:14.133065 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:25:14.133666 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:14.133683 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:14.134007 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:14.134271 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:14.135130 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:14.136164 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:14.137315 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:14.137765 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:14.137881 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:14.140483 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:14.140488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:14.140500 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:14.140526 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:14.142079 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:14.142560 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:14.142565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:14.142570 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:14.142675 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:14.142992 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:14.142995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:14.142996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:14.143401 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:14.143598 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:14.143924 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:25:14.144131 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260812 11:25:14.146633 21426 raft_consensus.cc:348] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d042e7320c2541c99d1406fc07863d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260812 11:25:14.146884 21426 raft_consensus.cc:374] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:14.146957 21426 raft_consensus.cc:729] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d042e7320c2541c99d1406fc07863d74, State: Initialized, Role: FOLLOWER
I20260812 11:25:14.147385 21426 consensus_queue.cc:260] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d042e7320c2541c99d1406fc07863d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260812 11:25:14.147503 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:14.147545 21426 raft_consensus.cc:388] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:14.147612 21426 raft_consensus.cc:482] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:14.147707 21426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:14.148490 21426 raft_consensus.cc:504] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d042e7320c2541c99d1406fc07863d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260812 11:25:14.148837 21426 leader_election.cc:302] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d042e7320c2541c99d1406fc07863d74; no voters:
I20260812 11:25:14.149154 21426 leader_election.cc:288] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:14.149194 21439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:14.149417 21439 raft_consensus.cc:686] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [term 1 LEADER]: Becoming Leader. State: Replica: d042e7320c2541c99d1406fc07863d74, State: Running, Role: LEADER
I20260812 11:25:14.149724 21439 consensus_queue.cc:237] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d042e7320c2541c99d1406fc07863d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260812 11:25:14.150434 21426 sys_catalog.cc:564] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:14.151105 21443 sys_catalog.cc:455] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d042e7320c2541c99d1406fc07863d74. Latest consensus state: current_term: 1 leader_uuid: "d042e7320c2541c99d1406fc07863d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d042e7320c2541c99d1406fc07863d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } } }
I20260812 11:25:14.151225 21443 sys_catalog.cc:458] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:14.151600 21460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:14.151561 21445 sys_catalog.cc:455] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d042e7320c2541c99d1406fc07863d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d042e7320c2541c99d1406fc07863d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } } }
I20260812 11:25:14.151655 21445 sys_catalog.cc:458] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:14.154663 21460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:14.158416 21432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:14.149631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:60699 (local address 127.0.0.1:45987)
0812 11:25:14.149721 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:14.149725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:14.149891 (+ 166us) server_negotiation.cc:407] Connection header received
0812 11:25:14.150052 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:14.150055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:14.150101 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:14.150180 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:14.150947 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:14.151767 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:14.153003 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:14.153326 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:14.153413 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:14.155080 (+ 1667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:14.155084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:14.155086 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:14.155111 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:14.156732 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:14.157247 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:14.157250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:14.157252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:14.157329 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:14.157630 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:14.157633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:14.157635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:14.157796 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:14.157920 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:14.158192 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:25:14.158274 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 11:25:14.160606 21460 catalog_manager.cc:1347] Generated new cluster ID: 5d76ce4b4d264af887e57701cdf29af7
I20260812 11:25:14.160656 21460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:14.168308 21460 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:14.169082 21460 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:14.177626 21460 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d042e7320c2541c99d1406fc07863d74: Generated new TSK 0
I20260812 11:25:14.178175 21460 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:14.184398 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21286
W20260812 11:25:14.205544 21259 connection.cc:535] client connection to 127.0.0.1:45987 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45987): Connection reset by peer (error 104)
2026-08-12T11:25:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:14 dist-test-slave-gjrz krb5kdc[21480](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:14 dist-test-slave-gjrz krb5kdc[21480](info): set up 2 sockets
Aug 12 11:25:14 dist-test-slave-gjrz krb5kdc[21480](info): commencing operation
krb5kdc: starting...
W20260812 11:25:15.382845 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:15 dist-test-slave-gjrz krb5kdc[21480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:15.496495 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34095
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:15.602383 21503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:15.602614 21503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:15.602653 21503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:15.606525 21503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:15.606576 21503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:15.606594 21503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:15.606609 21503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:15.606622 21503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:15.611580 21503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:15.612478 21503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:15.613327 21503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:15.621069 21513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:15.621073 21518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:15.621124 21515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:15.621440 21503 server_base.cc:1034] running on GCE node
I20260812 11:25:15.621927 21503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:15.622888 21503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:15.624044 21503 hybrid_clock.cc:648] HybridClock initialized: now 1786533915624020 us; error 33 us; skew 500 ppm
Aug 12 11:25:15 dist-test-slave-gjrz krb5kdc[21480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533915, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:15.632241 21503 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:15.633067 21503 webserver.cc:460] Webserver started at http://127.0.0.1:44573/ using document root <none> and password file <none>
I20260812 11:25:15.633555 21503 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:15.633617 21503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:15.633812 21503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:15.635735 21503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "f760a3813ba4405da8bb7c9304f4c844"
format_stamp: "Formatted at 2026-08-12 11:25:15 on dist-test-slave-gjrz"
server_key: "a6f615589f3003e7af780ebba9ba58fd"
server_key_iv: "9e1c7726daa06cd2e851725c220691ec"
server_key_version: "encryptionkey@0"
I20260812 11:25:15.636246 21503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "f760a3813ba4405da8bb7c9304f4c844"
format_stamp: "Formatted at 2026-08-12 11:25:15 on dist-test-slave-gjrz"
server_key: "a6f615589f3003e7af780ebba9ba58fd"
server_key_iv: "9e1c7726daa06cd2e851725c220691ec"
server_key_version: "encryptionkey@0"
I20260812 11:25:15.639662 21503 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:25:15.641865 21533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:15.643002 21503 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:15.643107 21503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "f760a3813ba4405da8bb7c9304f4c844"
format_stamp: "Formatted at 2026-08-12 11:25:15 on dist-test-slave-gjrz"
server_key: "a6f615589f3003e7af780ebba9ba58fd"
server_key_iv: "9e1c7726daa06cd2e851725c220691ec"
server_key_version: "encryptionkey@0"
I20260812 11:25:15.643193 21503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:15.660390 21503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:15.663189 21503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:15.663376 21503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:15.669706 21503 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34095
I20260812 11:25:15.669715 21637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34095 every 8 connection(s)
I20260812 11:25:15.670552 21503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:15.671955 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21503
I20260812 11:25:15.672096 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:15.672389 12991 external_mini_cluster.cc:1428] Setting key 8cdc3f72b51a29cd85522491839072d7
I20260812 11:25:15.673588 21640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:15.679435 21640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844: Bootstrap starting.
I20260812 11:25:15.680696 21644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:15.673611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:51289 (local address 127.0.0.1:34095)
0812 11:25:15.674021 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:15.674036 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:15.674070 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:25:15.674667 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:15.674683 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:15.674998 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:15.675251 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:15.675633 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:15.676608 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:15.677774 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:15.678228 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:15.678334 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:15.679151 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:15.679155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:15.679167 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:15.679553 (+ 386us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:15.679613 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:15.679637 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:15.679736 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:15.679911 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 11:25:15.680036 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":109,"threads_started":1}
I20260812 11:25:15.681674 21640 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:15.682485 21640 log.cc:824] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:15.683475 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:15.684613 21640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844: No bootstrap required, opened a new log
I20260812 11:25:15.688078 21640 raft_consensus.cc:348] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f760a3813ba4405da8bb7c9304f4c844" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34095 } }
I20260812 11:25:15.688347 21640 raft_consensus.cc:374] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:15.688412 21640 raft_consensus.cc:729] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f760a3813ba4405da8bb7c9304f4c844, State: Initialized, Role: FOLLOWER
I20260812 11:25:15.688834 21640 consensus_queue.cc:260] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f760a3813ba4405da8bb7c9304f4c844" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34095 } }
I20260812 11:25:15.688961 21640 raft_consensus.cc:388] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:15.689023 21640 raft_consensus.cc:482] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:15.689121 21640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:15.689847 21644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:15.685674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:40275 (local address 127.0.0.1:34095)
0812 11:25:15.685764 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:15.685768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:15.685924 (+ 156us) server_negotiation.cc:407] Connection header received
0812 11:25:15.686036 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:15.686038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:15.686074 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:15.686132 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:15.686384 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:15.687172 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:15.688288 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:15.688606 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:15.688694 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:15.689465 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:15.689469 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:15.689471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:15.689483 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:15.689510 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:15.689523 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:15.689609 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:15.689691 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 11:25:15.689725 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 11:25:15.690124 21640 raft_consensus.cc:504] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f760a3813ba4405da8bb7c9304f4c844" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34095 } }
I20260812 11:25:15.690446 21640 leader_election.cc:302] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f760a3813ba4405da8bb7c9304f4c844; no voters:
I20260812 11:25:15.690721 21640 leader_election.cc:288] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:15.690804 21663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:15.690979 21663 raft_consensus.cc:686] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [term 1 LEADER]: Becoming Leader. State: Replica: f760a3813ba4405da8bb7c9304f4c844, State: Running, Role: LEADER
I20260812 11:25:15.691285 21663 consensus_queue.cc:237] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f760a3813ba4405da8bb7c9304f4c844" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34095 } }
I20260812 11:25:15.691956 21640 sys_catalog.cc:564] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:15.692883 21669 sys_catalog.cc:455] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f760a3813ba4405da8bb7c9304f4c844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f760a3813ba4405da8bb7c9304f4c844" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34095 } } }
I20260812 11:25:15.693017 21669 sys_catalog.cc:458] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:15.693293 21671 sys_catalog.cc:455] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f760a3813ba4405da8bb7c9304f4c844. Latest consensus state: current_term: 1 leader_uuid: "f760a3813ba4405da8bb7c9304f4c844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f760a3813ba4405da8bb7c9304f4c844" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34095 } } }
I20260812 11:25:15.693382 21671 sys_catalog.cc:458] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:15.693509 21688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:15.696627 21688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:15.701951 21688 catalog_manager.cc:1347] Generated new cluster ID: dec77a2d1533455f9befc0bdb07870ee
I20260812 11:25:15.702014 21688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:15.710462 21688 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:15.711629 21688 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:15.717552 21688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f760a3813ba4405da8bb7c9304f4c844: Generated new TSK 0
I20260812 11:25:15.718248 21688 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:15.725761 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21503
W20260812 11:25:15.742075 21477 connection.cc:535] client connection to 127.0.0.1:34095 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34095): Connection reset by peer (error 104)
2026-08-12T11:25:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:15 dist-test-slave-gjrz krb5kdc[21712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:15 dist-test-slave-gjrz krb5kdc[21712](info): set up 2 sockets
Aug 12 11:25:15 dist-test-slave-gjrz krb5kdc[21712](info): commencing operation
krb5kdc: starting...
W20260812 11:25:16.919742 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:16 dist-test-slave-gjrz krb5kdc[21712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:17.031047 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:17.137176 21738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:17.137426 21738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:17.137485 21738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:17.141461 21738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:17.141520 21738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:17.141546 21738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:17.141567 21738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:17.141595 21738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:17.146703 21738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:17.147675 21738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:17.148638 21738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:17.156414 21749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:17.156466 21752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:17.156497 21755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:17.156649 21738 server_base.cc:1034] running on GCE node
I20260812 11:25:17.157209 21738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:17.158205 21738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:17.159341 21738 hybrid_clock.cc:648] HybridClock initialized: now 1786533917159318 us; error 31 us; skew 500 ppm
Aug 12 11:25:17 dist-test-slave-gjrz krb5kdc[21712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533917, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:17.161958 21738 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:17.162765 21738 webserver.cc:460] Webserver started at http://127.0.0.1:34979/ using document root <none> and password file <none>
I20260812 11:25:17.163307 21738 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:17.163378 21738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:17.163563 21738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:17.165479 21738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "ca616e1437634edea09cef052735e3f0"
format_stamp: "Formatted at 2026-08-12 11:25:17 on dist-test-slave-gjrz"
server_key: "e320b3c016c268448e3280c23a868a31"
server_key_iv: "ce5b0fee2b858d5fb86fce4c11ac51b0"
server_key_version: "encryptionkey@0"
I20260812 11:25:17.166020 21738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "ca616e1437634edea09cef052735e3f0"
format_stamp: "Formatted at 2026-08-12 11:25:17 on dist-test-slave-gjrz"
server_key: "e320b3c016c268448e3280c23a868a31"
server_key_iv: "ce5b0fee2b858d5fb86fce4c11ac51b0"
server_key_version: "encryptionkey@0"
I20260812 11:25:17.169445 21738 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:25:17.171622 21765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:17.172735 21738 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:25:17.172852 21738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "ca616e1437634edea09cef052735e3f0"
format_stamp: "Formatted at 2026-08-12 11:25:17 on dist-test-slave-gjrz"
server_key: "e320b3c016c268448e3280c23a868a31"
server_key_iv: "ce5b0fee2b858d5fb86fce4c11ac51b0"
server_key_version: "encryptionkey@0"
I20260812 11:25:17.172941 21738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:17.177307 21738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:17.179945 21738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:17.180099 21738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:17.186761 21738 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42431
I20260812 11:25:17.186775 21878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42431 every 8 connection(s)
I20260812 11:25:17.187623 21738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:17.190150 21879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:17.195135 21879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0: Bootstrap starting.
I20260812 11:25:17.195986 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 21738
I20260812 11:25:17.196110 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:17.196336 12991 external_mini_cluster.cc:1428] Setting key c90a99ea3ce8426ea418aae810aca01b
I20260812 11:25:17.197619 21879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:17.198285 21879 log.cc:824] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:17.200409 21879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0: No bootstrap required, opened a new log
I20260812 11:25:17.200930 21885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:17.197300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:46233 (local address 127.0.0.1:42431)
0812 11:25:17.197673 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:17.197686 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:17.197723 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:25:17.198328 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:17.198343 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:17.198644 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:17.199004 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:17.199788 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:17.199792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:17.199804 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:17.199814 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:17.199863 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:17.199880 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:17.199962 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:17.200097 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:25:17.200252 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":98,"threads_started":1}
I20260812 11:25:17.203691 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:17.204298 21879 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca616e1437634edea09cef052735e3f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42431 } }
I20260812 11:25:17.204568 21879 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:17.204638 21879 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca616e1437634edea09cef052735e3f0, State: Initialized, Role: FOLLOWER
I20260812 11:25:17.205090 21879 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca616e1437634edea09cef052735e3f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42431 } }
I20260812 11:25:17.205267 21879 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:17.205341 21879 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:17.205448 21879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:17.206431 21879 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca616e1437634edea09cef052735e3f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42431 } }
I20260812 11:25:17.206761 21879 leader_election.cc:302] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca616e1437634edea09cef052735e3f0; no voters:
I20260812 11:25:17.207058 21879 leader_election.cc:288] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:17.207131 21902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:17.207338 21902 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [term 1 LEADER]: Becoming Leader. State: Replica: ca616e1437634edea09cef052735e3f0, State: Running, Role: LEADER
I20260812 11:25:17.207738 21885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:17.205954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:47627 (local address 127.0.0.1:42431)
0812 11:25:17.206062 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:17.206066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:17.206370 (+ 304us) server_negotiation.cc:407] Connection header received
0812 11:25:17.206491 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:17.206492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:17.206521 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:17.206595 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:17.207314 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:17.207318 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:17.207320 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:17.207333 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:17.207359 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:17.207373 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:17.207450 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:17.207587 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 11:25:17.207621 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:25:17.207616 21902 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca616e1437634edea09cef052735e3f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42431 } }
I20260812 11:25:17.208269 21879 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:17.209584 21906 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca616e1437634edea09cef052735e3f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca616e1437634edea09cef052735e3f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42431 } } }
I20260812 11:25:17.209583 21915 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca616e1437634edea09cef052735e3f0. Latest consensus state: current_term: 1 leader_uuid: "ca616e1437634edea09cef052735e3f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca616e1437634edea09cef052735e3f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42431 } } }
I20260812 11:25:17.209741 21915 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:17.209946 21906 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:17.210150 21947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:17.212795 21947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:17.217370 21947 catalog_manager.cc:1347] Generated new cluster ID: e939c071224a4465b9c329be1f5bc97d
I20260812 11:25:17.217442 21947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:17.233258 21947 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:17.233549 21947 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:17.241266 21947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca616e1437634edea09cef052735e3f0: Generated new TSK 0
I20260812 11:25:17.241940 21947 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:17.255147 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 21738
2026-08-12T11:25:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1535 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:17 dist-test-slave-gjrz krb5kdc[21970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:17 dist-test-slave-gjrz krb5kdc[21970](info): set up 2 sockets
Aug 12 11:25:17 dist-test-slave-gjrz krb5kdc[21970](info): commencing operation
krb5kdc: starting...
W20260812 11:25:18.474270 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:18 dist-test-slave-gjrz krb5kdc[21970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:18.585376 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38291
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:18.690044 22000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:18.690266 22000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:18.690303 22000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:18.694139 22000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:18.694188 22000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:18.694206 22000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:18.694221 22000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:18.694234 22000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:18.699136 22000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38291
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:18.699968 22000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:18.700817 22000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:18.708461 22012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:18.708465 22014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:18.708657 22000 server_base.cc:1034] running on GCE node
W20260812 11:25:18.708573 22017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:18.709260 22000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:18.710273 22000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:18.711431 22000 hybrid_clock.cc:648] HybridClock initialized: now 1786533918711410 us; error 30 us; skew 500 ppm
Aug 12 11:25:18 dist-test-slave-gjrz krb5kdc[21970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533918, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:18.713933 22000 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:18.714704 22000 webserver.cc:460] Webserver started at http://127.0.0.1:41549/ using document root <none> and password file <none>
I20260812 11:25:18.715186 22000 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:18.715245 22000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:18.715452 22000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:18.717265 22000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "0a9237e64aa146d2888d4685561bc601"
format_stamp: "Formatted at 2026-08-12 11:25:18 on dist-test-slave-gjrz"
server_key: "6a526288c3d84f4022577655430a4f30"
server_key_iv: "90d4445bfc646213d873b5f12546d9b1"
server_key_version: "encryptionkey@0"
I20260812 11:25:18.717777 22000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "0a9237e64aa146d2888d4685561bc601"
format_stamp: "Formatted at 2026-08-12 11:25:18 on dist-test-slave-gjrz"
server_key: "6a526288c3d84f4022577655430a4f30"
server_key_iv: "90d4445bfc646213d873b5f12546d9b1"
server_key_version: "encryptionkey@0"
I20260812 11:25:18.721241 22000 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 11:25:18.723428 22036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:18.724522 22000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:18.724620 22000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "0a9237e64aa146d2888d4685561bc601"
format_stamp: "Formatted at 2026-08-12 11:25:18 on dist-test-slave-gjrz"
server_key: "6a526288c3d84f4022577655430a4f30"
server_key_iv: "90d4445bfc646213d873b5f12546d9b1"
server_key_version: "encryptionkey@0"
I20260812 11:25:18.724712 22000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:18.743191 22000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:18.745656 22000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:18.745810 22000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:18.752172 22000 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38291
I20260812 11:25:18.752206 22133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38291 every 8 connection(s)
I20260812 11:25:18.753044 22000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:18.755652 22135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:18.760353 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22000
I20260812 11:25:18.760473 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:18.760715 12991 external_mini_cluster.cc:1428] Setting key 407848a2e9f2656a087d5c7f6920651a
I20260812 11:25:18.760977 22135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601: Bootstrap starting.
I20260812 11:25:18.763382 22135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:18.764077 22135 log.cc:824] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:18.765838 22135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601: No bootstrap required, opened a new log
Aug 12 11:25:18 dist-test-slave-gjrz krb5kdc[21970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:25:18.769309 22135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a9237e64aa146d2888d4685561bc601" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38291 } }
I20260812 11:25:18.769515 22135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:18.769582 22135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a9237e64aa146d2888d4685561bc601, State: Initialized, Role: FOLLOWER
I20260812 11:25:18.770010 22135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a9237e64aa146d2888d4685561bc601" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38291 } }
I20260812 11:25:18.770186 22135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:18.770257 22135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:18.770355 22135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:18.771183 22135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a9237e64aa146d2888d4685561bc601" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38291 } }
I20260812 11:25:18.771522 22135 leader_election.cc:302] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a9237e64aa146d2888d4685561bc601; no voters:
I20260812 11:25:18.771821 22135 leader_election.cc:288] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:18.771898 22141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:18.772094 22141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [term 1 LEADER]: Becoming Leader. State: Replica: 0a9237e64aa146d2888d4685561bc601, State: Running, Role: LEADER
I20260812 11:25:18.772385 22141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a9237e64aa146d2888d4685561bc601" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38291 } }
I20260812 11:25:18.773073 22135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:18.773435 22141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a9237e64aa146d2888d4685561bc601. Latest consensus state: current_term: 1 leader_uuid: "0a9237e64aa146d2888d4685561bc601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a9237e64aa146d2888d4685561bc601" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38291 } } }
I20260812 11:25:18.773567 22141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:18.774132 22144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a9237e64aa146d2888d4685561bc601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a9237e64aa146d2888d4685561bc601" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38291 } } }
I20260812 11:25:18.774245 22144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:18.774924 22139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:18.761942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:44677 (local address 127.0.0.1:38291)
0812 11:25:18.762388 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:18.762403 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:18.762448 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:25:18.763056 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:18.763080 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:18.763471 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:18.763800 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:18.764631 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:18.765599 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:18.766496 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:18.766958 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:18.767113 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:18.769549 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:18.769556 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:18.769573 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:18.769605 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:18.771256 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:18.771747 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:18.771755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:18.771761 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:18.771911 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:18.772390 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:18.772393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:18.772395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:18.772878 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:18.773098 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:18.773447 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 11:25:18.773796 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":136,"threads_started":1}
I20260812 11:25:18.777866 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 11:25:18.778219 22173 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:18.778293 22173 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:18.778381 22148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:18.779031 22148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:18.784340 22148 catalog_manager.cc:1347] Generated new cluster ID: ba2e795fddf84e7fb76eb028007112ee
I20260812 11:25:18.784395 22148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:18.791465 22139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:18.780378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:59171 (local address 127.0.0.1:38291)
0812 11:25:18.780485 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:18.780489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:18.780503 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:25:18.780619 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:18.780622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:18.780664 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:18.780745 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:18.781481 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:18.782266 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:18.783281 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:18.783631 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:18.783735 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:18.788341 (+ 4606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:18.788345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:18.788348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:18.788373 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:18.789824 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:18.790317 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:18.790320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:18.790322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:18.790391 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:18.790682 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:18.790685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:18.790687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:18.790855 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:18.790976 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:18.791216 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 11:25:18.791327 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:25:18.827239 22148 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:18.828215 22148 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:18.837200 22148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a9237e64aa146d2888d4685561bc601: Generated new TSK 0
I20260812 11:25:18.837898 22148 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:18.852020 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22000
W20260812 11:25:18.866627 21968 connection.cc:535] client connection to 127.0.0.1:38291 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38291): Connection reset by peer (error 104)
2026-08-12T11:25:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1588 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:18 dist-test-slave-gjrz krb5kdc[22208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:18 dist-test-slave-gjrz krb5kdc[22208](info): set up 2 sockets
Aug 12 11:25:18 dist-test-slave-gjrz krb5kdc[22208](info): commencing operation
krb5kdc: starting...
W20260812 11:25:20.047492 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:20 dist-test-slave-gjrz krb5kdc[22208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:20.162117 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33745
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:20.268977 22231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:20.269194 22231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:20.269232 22231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:20.273068 22231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:20.273115 22231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:20.273150 22231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:20.273175 22231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:20.273193 22231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:20.278067 22231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33745
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:20.278914 22231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:20.279978 22231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:20.287649 22240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:20.287667 22241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:20.287827 22231 server_base.cc:1034] running on GCE node
W20260812 11:25:20.287681 22243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:20.288328 22231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:20.289294 22231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:20.290450 22231 hybrid_clock.cc:648] HybridClock initialized: now 1786533920290436 us; error 26 us; skew 500 ppm
Aug 12 11:25:20 dist-test-slave-gjrz krb5kdc[22208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533920, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:20.292914 22231 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:20.293671 22231 webserver.cc:460] Webserver started at http://127.0.0.1:40605/ using document root <none> and password file <none>
I20260812 11:25:20.294148 22231 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:20.294209 22231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:20.294377 22231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:20.296238 22231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "fc877e9f6f5b431cac07d115ce5cd0e9"
format_stamp: "Formatted at 2026-08-12 11:25:20 on dist-test-slave-gjrz"
server_key: "5e8b02039de5dfd7115f131c4776d714"
server_key_iv: "19b70294667c62490c98574e6abb5ba2"
server_key_version: "encryptionkey@0"
I20260812 11:25:20.296747 22231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "fc877e9f6f5b431cac07d115ce5cd0e9"
format_stamp: "Formatted at 2026-08-12 11:25:20 on dist-test-slave-gjrz"
server_key: "5e8b02039de5dfd7115f131c4776d714"
server_key_iv: "19b70294667c62490c98574e6abb5ba2"
server_key_version: "encryptionkey@0"
I20260812 11:25:20.300063 22231 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:20.302176 22251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:20.303313 22231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:25:20.303421 22231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "fc877e9f6f5b431cac07d115ce5cd0e9"
format_stamp: "Formatted at 2026-08-12 11:25:20 on dist-test-slave-gjrz"
server_key: "5e8b02039de5dfd7115f131c4776d714"
server_key_iv: "19b70294667c62490c98574e6abb5ba2"
server_key_version: "encryptionkey@0"
I20260812 11:25:20.303503 22231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:20.337145 22231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:20.339653 22231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:20.339818 22231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:20.346243 22231 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33745
I20260812 11:25:20.346264 22356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33745 every 8 connection(s)
I20260812 11:25:20.347131 22231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:20.347344 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22231
I20260812 11:25:20.347477 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:20.347805 12991 external_mini_cluster.cc:1428] Setting key 74a12829b7cff5fd3b7539366d5cfd3e
I20260812 11:25:20.350350 22359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:20.357182 22359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9: Bootstrap starting.
I20260812 11:25:20.357503 22363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:20.349156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:57455 (local address 127.0.0.1:33745)
0812 11:25:20.349564 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:20.349583 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:20.349627 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:25:20.350440 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:20.350463 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:20.350877 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:20.351243 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:20.351655 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:20.353134 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:20.353958 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:20.354635 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:20.354791 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:20.355607 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:20.355613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:20.355629 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:20.356102 (+ 473us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:20.356187 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:20.356217 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:20.356351 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:20.356479 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 11:25:20.356603 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":107,"threads_started":1}
I20260812 11:25:20.359669 22359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:20.360359 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:20.360508 22359 log.cc:824] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:20.362638 22359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9: No bootstrap required, opened a new log
I20260812 11:25:20.366045 22363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:20.362464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:43415 (local address 127.0.0.1:33745)
0812 11:25:20.362582 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:20.362586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:20.362767 (+ 181us) server_negotiation.cc:407] Connection header received
0812 11:25:20.362882 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:20.362885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:20.362924 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:20.362984 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:20.363232 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:20.363752 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:20.364547 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:20.364764 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:20.364847 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:20.365604 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:20.365607 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:20.365609 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:20.365620 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:20.365643 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:20.365652 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:20.365720 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:20.365856 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:25:20.365887 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:25:20.365959 22359 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33745 } }
I20260812 11:25:20.366255 22359 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:20.366317 22359 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc877e9f6f5b431cac07d115ce5cd0e9, State: Initialized, Role: FOLLOWER
I20260812 11:25:20.366808 22359 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33745 } }
I20260812 11:25:20.366972 22359 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:20.367043 22359 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:20.367144 22359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:20.367970 22359 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33745 } }
I20260812 11:25:20.368258 22359 leader_election.cc:302] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc877e9f6f5b431cac07d115ce5cd0e9; no voters:
I20260812 11:25:20.368489 22359 leader_election.cc:288] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:20.368593 22375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:20.368795 22375 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [term 1 LEADER]: Becoming Leader. State: Replica: fc877e9f6f5b431cac07d115ce5cd0e9, State: Running, Role: LEADER
I20260812 11:25:20.369122 22375 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33745 } }
I20260812 11:25:20.369580 22359 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:20.370770 22377 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33745 } } }
I20260812 11:25:20.370913 22377 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:20.370775 22381 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc877e9f6f5b431cac07d115ce5cd0e9. Latest consensus state: current_term: 1 leader_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc877e9f6f5b431cac07d115ce5cd0e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33745 } } }
I20260812 11:25:20.371155 22381 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:20.371284 22395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:20.374148 22395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:20.379276 22395 catalog_manager.cc:1347] Generated new cluster ID: 0b8282a9aef444feaff3dbd234c2ec32
I20260812 11:25:20.379333 22395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:20.404448 22395 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:20.405243 22395 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:20.420825 22395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc877e9f6f5b431cac07d115ce5cd0e9: Generated new TSK 0
I20260812 11:25:20.421396 22395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:20.431140 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22231
W20260812 11:25:20.444687 22204 connection.cc:535] client connection to 127.0.0.1:33745 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33745): Connection reset by peer (error 104)
2026-08-12T11:25:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:20 dist-test-slave-gjrz krb5kdc[22433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:20 dist-test-slave-gjrz krb5kdc[22433](info): set up 2 sockets
Aug 12 11:25:20 dist-test-slave-gjrz krb5kdc[22433](info): commencing operation
krb5kdc: starting...
W20260812 11:25:21.621662 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:21 dist-test-slave-gjrz krb5kdc[22433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:25:21.732427 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36991
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:21.838236 22462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:21.838447 22462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:21.838485 22462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:21.842344 22462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:21.842393 22462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:21.842410 22462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:21.842425 22462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:21.842443 22462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:21.847421 22462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36991
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:21.848253 22462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:21.849108 22462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:21.856806 22476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:21.856798 22470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:21.856799 22468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:21.857050 22462 server_base.cc:1034] running on GCE node
I20260812 11:25:21.857707 22462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:21.858690 22462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:21.859848 22462 hybrid_clock.cc:648] HybridClock initialized: now 1786533921859831 us; error 28 us; skew 500 ppm
Aug 12 11:25:21 dist-test-slave-gjrz krb5kdc[22433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533921, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:21.865131 22462 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:25:21.865912 22462 webserver.cc:460] Webserver started at http://127.0.0.1:43957/ using document root <none> and password file <none>
I20260812 11:25:21.866400 22462 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:21.866463 22462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:21.866637 22462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:21.868502 22462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "1dcd336c6195486ea153e2ae42ebfa7f"
format_stamp: "Formatted at 2026-08-12 11:25:21 on dist-test-slave-gjrz"
server_key: "bbaf96d698c505ff662e2cb29d1d4aeb"
server_key_iv: "3b07d86b96b55873e2153f5b194d423d"
server_key_version: "encryptionkey@0"
I20260812 11:25:21.869014 22462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "1dcd336c6195486ea153e2ae42ebfa7f"
format_stamp: "Formatted at 2026-08-12 11:25:21 on dist-test-slave-gjrz"
server_key: "bbaf96d698c505ff662e2cb29d1d4aeb"
server_key_iv: "3b07d86b96b55873e2153f5b194d423d"
server_key_version: "encryptionkey@0"
I20260812 11:25:21.872349 22462 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:21.874457 22488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:21.875566 22462 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:25:21.875674 22462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "1dcd336c6195486ea153e2ae42ebfa7f"
format_stamp: "Formatted at 2026-08-12 11:25:21 on dist-test-slave-gjrz"
server_key: "bbaf96d698c505ff662e2cb29d1d4aeb"
server_key_iv: "3b07d86b96b55873e2153f5b194d423d"
server_key_version: "encryptionkey@0"
I20260812 11:25:21.875756 22462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:21.879860 22462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:21.882575 22462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:21.882730 22462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:21.888974 22462 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36991
I20260812 11:25:21.888988 22592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36991 every 8 connection(s)
I20260812 11:25:21.889755 22462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:21.892304 22593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:21.897251 22593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f: Bootstrap starting.
I20260812 11:25:21.897650 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22462
I20260812 11:25:21.897779 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:21.898072 12991 external_mini_cluster.cc:1428] Setting key 9185bcfcb2ef2fd54c040698b73760c1
I20260812 11:25:21.899991 22593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:21.900840 22593 log.cc:824] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:21.902820 22593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f: No bootstrap required, opened a new log
I20260812 11:25:21.903452 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:21.899565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:51321 (local address 127.0.0.1:36991)
0812 11:25:21.900016 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:21.900035 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:21.900076 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:25:21.900864 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:21.900889 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:21.901235 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:21.901534 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:21.902253 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:21.902258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:21.902270 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:21.902281 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:21.902331 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:21.902350 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:21.902441 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:21.902569 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 11:25:21.902736 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":127,"threads_started":1}
I20260812 11:25:21.906050 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:21.906591 22593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36991 } }
I20260812 11:25:21.906780 22593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:21.906834 22593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dcd336c6195486ea153e2ae42ebfa7f, State: Initialized, Role: FOLLOWER
I20260812 11:25:21.907233 22593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36991 } }
I20260812 11:25:21.907413 22593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:21.907477 22593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:21.907568 22593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:21.908493 22593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36991 } }
I20260812 11:25:21.908797 22593 leader_election.cc:302] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dcd336c6195486ea153e2ae42ebfa7f; no voters:
I20260812 11:25:21.909092 22593 leader_election.cc:288] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:21.909170 22618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:21.909372 22618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [term 1 LEADER]: Becoming Leader. State: Replica: 1dcd336c6195486ea153e2ae42ebfa7f, State: Running, Role: LEADER
I20260812 11:25:21.909641 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:21.907981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:47971 (local address 127.0.0.1:36991)
0812 11:25:21.908085 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:21.908088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:21.908247 (+ 159us) server_negotiation.cc:407] Connection header received
0812 11:25:21.908334 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:21.908337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:21.908368 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:21.908459 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:21.909053 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:21.909057 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:21.909059 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:21.909071 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:21.909097 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:21.909109 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:21.909190 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:21.909342 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 11:25:21.909382 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:25:21.909822 22618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36991 } }
I20260812 11:25:21.910221 22593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:21.910929 22618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dcd336c6195486ea153e2ae42ebfa7f. Latest consensus state: current_term: 1 leader_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36991 } } }
I20260812 11:25:21.911048 22618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:21.911438 22632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:21.911455 22620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dcd336c6195486ea153e2ae42ebfa7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36991 } } }
I20260812 11:25:21.911659 22620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:21.914366 22632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:21.919590 22632 catalog_manager.cc:1347] Generated new cluster ID: 626bd57b6ba9470e8a406166d2adf174
I20260812 11:25:21.919642 22632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:21.930099 22632 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:21.930354 22632 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:21.935326 22632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dcd336c6195486ea153e2ae42ebfa7f: Generated new TSK 0
I20260812 11:25:21.935866 22632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:21.938544 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22462
2026-08-12T11:25:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1511 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:21 dist-test-slave-gjrz krb5kdc[22655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:22 dist-test-slave-gjrz krb5kdc[22655](info): set up 2 sockets
Aug 12 11:25:22 dist-test-slave-gjrz krb5kdc[22655](info): commencing operation
krb5kdc: starting...
W20260812 11:25:23.144907 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:23 dist-test-slave-gjrz krb5kdc[22655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:23.258457 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:34819
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:35055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:34819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:23.365510 22675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:23.365729 22675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:23.365767 22675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:23.369622 22675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:23.369673 22675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:23.369691 22675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:23.369705 22675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:23.369725 22675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:23.374735 22675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:35055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:34819
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:34819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:23.375718 22675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:23.376667 22675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:23.384521 22689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:23.384552 22684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:23.384526 22685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:23.384688 22675 server_base.cc:1034] running on GCE node
I20260812 11:25:23.385295 22675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:23.386276 22675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:23.387427 22675 hybrid_clock.cc:648] HybridClock initialized: now 1786533923387410 us; error 28 us; skew 500 ppm
Aug 12 11:25:23 dist-test-slave-gjrz krb5kdc[22655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:23.389844 22675 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:23.390640 22675 webserver.cc:460] Webserver started at http://127.12.175.254:42325/ using document root <none> and password file <none>
I20260812 11:25:23.391134 22675 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:23.391197 22675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:23.391405 22675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:23.393268 22675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "2e1d2c5287b44ba0a2e3359bf8e16389"
format_stamp: "Formatted at 2026-08-12 11:25:23 on dist-test-slave-gjrz"
server_key: "04bedf5c460410cf4f0013d16e1fc666"
server_key_iv: "ec03f3f9e90262df9b0c9166de89216d"
server_key_version: "encryptionkey@0"
I20260812 11:25:23.393779 22675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "2e1d2c5287b44ba0a2e3359bf8e16389"
format_stamp: "Formatted at 2026-08-12 11:25:23 on dist-test-slave-gjrz"
server_key: "04bedf5c460410cf4f0013d16e1fc666"
server_key_iv: "ec03f3f9e90262df9b0c9166de89216d"
server_key_version: "encryptionkey@0"
I20260812 11:25:23.397228 22675 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:25:23.399372 22700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:23.400447 22675 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:23.400558 22675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "2e1d2c5287b44ba0a2e3359bf8e16389"
format_stamp: "Formatted at 2026-08-12 11:25:23 on dist-test-slave-gjrz"
server_key: "04bedf5c460410cf4f0013d16e1fc666"
server_key_iv: "ec03f3f9e90262df9b0c9166de89216d"
server_key_version: "encryptionkey@0"
I20260812 11:25:23.400652 22675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:23.419101 22675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:23.421492 22675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:23.421659 22675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:23.427980 22675 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:34819
I20260812 11:25:23.428011 22813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:34819 every 8 connection(s)
I20260812 11:25:23.428787 22675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:23.431350 22814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:23.433416 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22675
I20260812 11:25:23.433548 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:23.433795 12991 external_mini_cluster.cc:1428] Setting key 2e94f5766c2e3ae5652a39fb4435ec4c
I20260812 11:25:23.436872 22814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389: Bootstrap starting.
I20260812 11:25:23.439191 22814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:23.439985 22814 log.cc:824] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:23.441677 22814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389: No bootstrap required, opened a new log
Aug 12 11:25:23 dist-test-slave-gjrz krb5kdc[22655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:23.445273 22814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 34819 } }
I20260812 11:25:23.445504 22814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:23.445567 22814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1d2c5287b44ba0a2e3359bf8e16389, State: Initialized, Role: FOLLOWER
I20260812 11:25:23.446030 22814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 34819 } }
I20260812 11:25:23.446194 22814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:23.446259 22814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:23.446352 22814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:23.447373 22814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 34819 } }
I20260812 11:25:23.447727 22814 leader_election.cc:302] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e1d2c5287b44ba0a2e3359bf8e16389; no voters:
I20260812 11:25:23.447979 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:23.434978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34267 (local address 127.12.175.254:34819)
0812 11:25:23.435383 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:23.435398 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:23.435431 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:25:23.436028 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:23.436042 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:23.436357 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:23.436610 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:23.437489 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:23.438445 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:23.439611 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:23.440070 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:23.440235 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:23.442604 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:23.442610 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:23.442625 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:23.442654 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:23.444988 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:23.445456 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:23.445462 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:23.445468 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:23.445608 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:23.445902 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:23.445906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:23.445907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:23.446391 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:23.446606 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:23.446831 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 11:25:23.447043 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":115,"threads_started":1}
I20260812 11:25:23.448043 22814 leader_election.cc:288] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:23.448143 22825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:23.448334 22825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [term 1 LEADER]: Becoming Leader. State: Replica: 2e1d2c5287b44ba0a2e3359bf8e16389, State: Running, Role: LEADER
I20260812 11:25:23.448617 22825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 34819 } }
I20260812 11:25:23.449177 22814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:23.450285 22826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 34819 } } }
I20260812 11:25:23.450419 22826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:23.450296 22836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e1d2c5287b44ba0a2e3359bf8e16389. Latest consensus state: current_term: 1 leader_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e1d2c5287b44ba0a2e3359bf8e16389" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 34819 } } }
I20260812 11:25:23.450555 22836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:23.450829 22854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:23.451056 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:23.453882 22854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:23.459036 22854 catalog_manager.cc:1347] Generated new cluster ID: 9dcf105f2ec64336b207124806197a8a
I20260812 11:25:23.459091 22854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:23.465804 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:23.453165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42585 (local address 127.12.175.254:34819)
0812 11:25:23.453266 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:23.453270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:23.453700 (+ 430us) server_negotiation.cc:407] Connection header received
0812 11:25:23.453807 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:23.453810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:23.453852 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:23.453933 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:23.454718 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:23.455456 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:23.456626 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:23.456973 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:23.457072 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:23.458616 (+ 1544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:23.458620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:23.458623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:23.458649 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:23.464232 (+ 5583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:23.464653 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:23.464656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:23.464658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:23.464729 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:23.465023 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:23.465026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:23.465028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:23.465197 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:23.465328 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:23.465586 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 11:25:23.465669 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:25:23.501891 22854 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:23.502709 22854 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:23.510589 22854 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e1d2c5287b44ba0a2e3359bf8e16389: Generated new TSK 0
I20260812 11:25:23.511133 22854 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:23.518201 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22675
W20260812 11:25:23.536535 22651 connection.cc:535] client connection to 127.12.175.254:34819 recv error: Network error: failed to read from TLS socket (remote: 127.12.175.254:34819): Connection reset by peer (error 104)
2026-08-12T11:25:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:23 dist-test-slave-gjrz krb5kdc[22882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:23 dist-test-slave-gjrz krb5kdc[22882](info): set up 2 sockets
Aug 12 11:25:23 dist-test-slave-gjrz krb5kdc[22882](info): commencing operation
krb5kdc: starting...
W20260812 11:25:24.713450 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:24 dist-test-slave-gjrz krb5kdc[22882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:24.825774 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36429
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:36429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:24.931664 22905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:24.931879 22905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:24.931917 22905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:24.935808 22905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:24.935858 22905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:24.935878 22905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:24.935907 22905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:24.935933 22905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:24.940892 22905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:36429
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:36429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:24.941741 22905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:24.942644 22905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:24.950359 22914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:24.950486 22905 server_base.cc:1034] running on GCE node
W20260812 11:25:24.950516 22917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:24.950369 22919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:24.951211 22905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:24.952175 22905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:24.953331 22905 hybrid_clock.cc:648] HybridClock initialized: now 1786533924953318 us; error 23 us; skew 500 ppm
Aug 12 11:25:24 dist-test-slave-gjrz krb5kdc[22882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533924, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:24.955870 22905 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:24.956642 22905 webserver.cc:460] Webserver started at http://127.12.175.254:34415/ using document root <none> and password file <none>
I20260812 11:25:24.957123 22905 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:24.957181 22905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:24.957363 22905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:24.959199 22905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "4ea6740eb00541dfa593c4d6572614b2"
format_stamp: "Formatted at 2026-08-12 11:25:24 on dist-test-slave-gjrz"
server_key: "604e0629321084a9153c5b066002a295"
server_key_iv: "5203305e5ec1bfe83a8580617254ccc9"
server_key_version: "encryptionkey@0"
I20260812 11:25:24.959764 22905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "4ea6740eb00541dfa593c4d6572614b2"
format_stamp: "Formatted at 2026-08-12 11:25:24 on dist-test-slave-gjrz"
server_key: "604e0629321084a9153c5b066002a295"
server_key_iv: "5203305e5ec1bfe83a8580617254ccc9"
server_key_version: "encryptionkey@0"
I20260812 11:25:24.963145 22905 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:25:24.965302 22930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:24.966377 22905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:24.966486 22905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "4ea6740eb00541dfa593c4d6572614b2"
format_stamp: "Formatted at 2026-08-12 11:25:24 on dist-test-slave-gjrz"
server_key: "604e0629321084a9153c5b066002a295"
server_key_iv: "5203305e5ec1bfe83a8580617254ccc9"
server_key_version: "encryptionkey@0"
I20260812 11:25:24.966573 22905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:24.982388 22905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:24.984858 22905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:24.985019 22905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:24.991245 22905 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:36429
I20260812 11:25:24.991313 23020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:36429 every 8 connection(s)
I20260812 11:25:24.992095 22905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:24.994555 23024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:24.999459 23024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2: Bootstrap starting.
I20260812 11:25:25.000818 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 22905
I20260812 11:25:25.000938 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:25.001179 12991 external_mini_cluster.cc:1428] Setting key 4a642c03183aae833f16712c4a2888bf
I20260812 11:25:25.001693 23024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:25.002511 23024 log.cc:824] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:25.004377 23024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2: No bootstrap required, opened a new log
I20260812 11:25:25.008175 23024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea6740eb00541dfa593c4d6572614b2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36429 } }
I20260812 11:25:25.008368 23024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:25.008401 23024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea6740eb00541dfa593c4d6572614b2, State: Initialized, Role: FOLLOWER
I20260812 11:25:25.008836 23024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea6740eb00541dfa593c4d6572614b2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36429 } }
I20260812 11:25:25.008988 23024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:25.009054 23024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:25.009158 23024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:25.009698 23032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:25.002157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47461 (local address 127.12.175.254:36429)
0812 11:25:25.002525 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:25.002540 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:25.002576 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:25:25.003451 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:25.003472 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:25.003793 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:25.004050 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:25.004401 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:25.005372 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:25.006583 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:25.007037 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:25.007151 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:25.008015 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:25.008020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:25.008033 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:25.008392 (+ 359us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:25.008460 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:25.008491 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:25.008592 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:25.008794 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 11:25:25.008920 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":104,"threads_started":1}
I20260812 11:25:25.009961 23024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea6740eb00541dfa593c4d6572614b2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36429 } }
I20260812 11:25:25.010268 23024 leader_election.cc:302] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ea6740eb00541dfa593c4d6572614b2; no voters:
I20260812 11:25:25.010540 23024 leader_election.cc:288] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:25.010643 23035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:25.010810 23035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4ea6740eb00541dfa593c4d6572614b2, State: Running, Role: LEADER
I20260812 11:25:25.011219 23035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea6740eb00541dfa593c4d6572614b2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36429 } }
I20260812 11:25:25.011730 23024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:25.012581 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:25.012758 23038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ea6740eb00541dfa593c4d6572614b2. Latest consensus state: current_term: 1 leader_uuid: "4ea6740eb00541dfa593c4d6572614b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea6740eb00541dfa593c4d6572614b2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36429 } } }
I20260812 11:25:25.012864 23038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:25.013144 23037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ea6740eb00541dfa593c4d6572614b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea6740eb00541dfa593c4d6572614b2" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 36429 } } }
I20260812 11:25:25.013223 23037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:25.014124 23059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:25.017442 23059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:25.019284 23032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:25.014741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60671 (local address 127.12.175.254:36429)
0812 11:25:25.014851 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:25.014856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:25.014992 (+ 136us) server_negotiation.cc:407] Connection header received
0812 11:25:25.015069 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:25.015072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:25.015114 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:25.015199 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:25.015461 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:25.016188 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:25.017299 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:25.017607 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:25.017705 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:25.018653 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:25.018656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:25.018659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:25.018672 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:25.018698 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:25.018710 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:25.018792 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:25.019101 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 11:25:25.019145 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:25:25.022769 23059 catalog_manager.cc:1347] Generated new cluster ID: cc33a029a3aa4c6c8d923b92e4f14838
I20260812 11:25:25.022830 23059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:25.029327 23059 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:25.030136 23059 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:25.040263 23059 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ea6740eb00541dfa593c4d6572614b2: Generated new TSK 0
I20260812 11:25:25.040822 23059 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:25.048159 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 22905
W20260812 11:25:25.073911 22879 connection.cc:535] client connection to 127.12.175.254:36429 recv error: Network error: failed to read from TLS socket (remote: 127.12.175.254:36429): Connection reset by peer (error 104)
2026-08-12T11:25:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1537 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:25 dist-test-slave-gjrz krb5kdc[23094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:25 dist-test-slave-gjrz krb5kdc[23094](info): set up 2 sockets
Aug 12 11:25:25 dist-test-slave-gjrz krb5kdc[23094](info): commencing operation
krb5kdc: starting...
W20260812 11:25:26.253859 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:26 dist-test-slave-gjrz krb5kdc[23094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:26.364167 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43279
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:46437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:43279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:26.468510 23117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:26.468732 23117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:26.468786 23117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:26.472606 23117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:26.472654 23117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:26.472681 23117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:26.472702 23117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:26.472729 23117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:26.477598 23117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:46437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:43279
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:43279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:26.478427 23117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:26.479315 23117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:26.486989 23122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:26.486987 23128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:26.487011 23123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:26.487212 23117 server_base.cc:1034] running on GCE node
I20260812 11:25:26.487787 23117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:26.488750 23117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:26.489909 23117 hybrid_clock.cc:648] HybridClock initialized: now 1786533926489890 us; error 28 us; skew 500 ppm
Aug 12 11:25:26 dist-test-slave-gjrz krb5kdc[23094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533926, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:26.492441 23117 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:26.493233 23117 webserver.cc:460] Webserver started at http://127.12.175.254:41785/ using document root <none> and password file <none>
I20260812 11:25:26.493716 23117 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:26.493774 23117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:26.493954 23117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:26.495831 23117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "83ca9040ea694664ab6940ea5683f01b"
format_stamp: "Formatted at 2026-08-12 11:25:26 on dist-test-slave-gjrz"
server_key: "d7f6ee2544d62ecd5aa1dbf7e7f5eeae"
server_key_iv: "31cb383500ec16398f81afd3eab8d9b8"
server_key_version: "encryptionkey@0"
I20260812 11:25:26.496328 23117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "83ca9040ea694664ab6940ea5683f01b"
format_stamp: "Formatted at 2026-08-12 11:25:26 on dist-test-slave-gjrz"
server_key: "d7f6ee2544d62ecd5aa1dbf7e7f5eeae"
server_key_iv: "31cb383500ec16398f81afd3eab8d9b8"
server_key_version: "encryptionkey@0"
I20260812 11:25:26.499955 23117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:26.502049 23141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:26.503106 23117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:25:26.503214 23117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "83ca9040ea694664ab6940ea5683f01b"
format_stamp: "Formatted at 2026-08-12 11:25:26 on dist-test-slave-gjrz"
server_key: "d7f6ee2544d62ecd5aa1dbf7e7f5eeae"
server_key_iv: "31cb383500ec16398f81afd3eab8d9b8"
server_key_version: "encryptionkey@0"
I20260812 11:25:26.503341 23117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:26.507431 23117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:26.509827 23117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:26.509974 23117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:26.516254 23117 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:43279
I20260812 11:25:26.516268 23238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:43279 every 8 connection(s)
I20260812 11:25:26.517031 23117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:26.518715 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23117
I20260812 11:25:26.518841 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:26.519083 12991 external_mini_cluster.cc:1428] Setting key fddcc40f6efc04e7708bf1ddcddfc484
I20260812 11:25:26.519716 23239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:26.524128 23246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:26.520305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53075 (local address 127.12.175.254:43279)
0812 11:25:26.520700 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:26.520718 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:26.520757 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:25:26.521529 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:26.521551 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:26.521899 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:26.522251 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:26.522829 (+ 578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:26.522834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:26.522848 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:26.522859 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:26.522915 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:26.522940 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:26.523086 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:26.523158 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:25:26.523318 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":110,"threads_started":1}
I20260812 11:25:26.525929 23239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b: Bootstrap starting.
I20260812 11:25:26.526623 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:26.528129 23239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:26.528868 23239 log.cc:824] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:26.529866 23246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:26.528465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40159 (local address 127.12.175.254:43279)
0812 11:25:26.528582 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:26.528586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:26.528786 (+ 200us) server_negotiation.cc:407] Connection header received
0812 11:25:26.528859 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:26.528862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:26.528895 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:26.528969 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:26.529528 (+ 559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:26.529532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:26.529534 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:26.529546 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:26.529571 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:26.529582 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:26.529649 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:26.529732 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 11:25:26.529763 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:25:26.530678 23239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b: No bootstrap required, opened a new log
I20260812 11:25:26.533895 23239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ca9040ea694664ab6940ea5683f01b" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43279 } }
I20260812 11:25:26.534104 23239 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:26.534153 23239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83ca9040ea694664ab6940ea5683f01b, State: Initialized, Role: FOLLOWER
I20260812 11:25:26.534483 23239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ca9040ea694664ab6940ea5683f01b" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43279 } }
I20260812 11:25:26.534585 23239 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:26.534627 23239 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:26.534691 23239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:26.535595 23239 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ca9040ea694664ab6940ea5683f01b" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43279 } }
I20260812 11:25:26.535902 23239 leader_election.cc:302] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83ca9040ea694664ab6940ea5683f01b; no voters:
I20260812 11:25:26.536141 23239 leader_election.cc:288] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:26.536255 23266 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:26.536458 23266 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [term 1 LEADER]: Becoming Leader. State: Replica: 83ca9040ea694664ab6940ea5683f01b, State: Running, Role: LEADER
I20260812 11:25:26.536777 23266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ca9040ea694664ab6940ea5683f01b" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43279 } }
I20260812 11:25:26.537176 23239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:26.538187 23268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83ca9040ea694664ab6940ea5683f01b. Latest consensus state: current_term: 1 leader_uuid: "83ca9040ea694664ab6940ea5683f01b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ca9040ea694664ab6940ea5683f01b" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43279 } } }
I20260812 11:25:26.538286 23268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:26.538568 23267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83ca9040ea694664ab6940ea5683f01b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83ca9040ea694664ab6940ea5683f01b" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 43279 } } }
I20260812 11:25:26.538652 23267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:26.538671 23283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:26.541417 23283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:26.546366 23283 catalog_manager.cc:1347] Generated new cluster ID: 252e00f858844770a957d080b5f36a87
I20260812 11:25:26.546464 23283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:26.554733 23283 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:26.554967 23283 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:26.562302 23283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83ca9040ea694664ab6940ea5683f01b: Generated new TSK 0
I20260812 11:25:26.562877 23283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:26.574805 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23117
2026-08-12T11:25:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1523 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:26 dist-test-slave-gjrz krb5kdc[23300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:26 dist-test-slave-gjrz krb5kdc[23300](info): set up 2 sockets
Aug 12 11:25:26 dist-test-slave-gjrz krb5kdc[23300](info): commencing operation
krb5kdc: starting...
W20260812 11:25:27.784130 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:27 dist-test-slave-gjrz krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:27.903810 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:35827
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:32893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:35827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:28.009407 23327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:28.009631 23327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:28.009670 23327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:28.013550 23327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:28.013599 23327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:28.013619 23327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:28.013649 23327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:28.013674 23327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:28.018644 23327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:32893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:35827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:35827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:28.019598 23327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:28.020527 23327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:28.028414 23341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:28.028483 23343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:28.028427 23338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:28.028729 23327 server_base.cc:1034] running on GCE node
I20260812 11:25:28.029238 23327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:28.030282 23327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:28.031432 23327 hybrid_clock.cc:648] HybridClock initialized: now 1786533928031418 us; error 24 us; skew 500 ppm
Aug 12 11:25:28 dist-test-slave-gjrz krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533928, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:28.033994 23327 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:28.034818 23327 webserver.cc:460] Webserver started at http://127.12.175.254:44637/ using document root <none> and password file <none>
I20260812 11:25:28.035378 23327 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:28.035451 23327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:28.035662 23327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:28.037600 23327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "89e958db3f304d7cb80524b111fc6252"
format_stamp: "Formatted at 2026-08-12 11:25:28 on dist-test-slave-gjrz"
server_key: "d6fb11092dde904209a113e725e1124c"
server_key_iv: "adbb9ebf29e166b794302e304b37cd7c"
server_key_version: "encryptionkey@0"
I20260812 11:25:28.038151 23327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "89e958db3f304d7cb80524b111fc6252"
format_stamp: "Formatted at 2026-08-12 11:25:28 on dist-test-slave-gjrz"
server_key: "d6fb11092dde904209a113e725e1124c"
server_key_iv: "adbb9ebf29e166b794302e304b37cd7c"
server_key_version: "encryptionkey@0"
I20260812 11:25:28.042013 23327 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:25:28.044329 23357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:28.045497 23327 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:25:28.045614 23327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "89e958db3f304d7cb80524b111fc6252"
format_stamp: "Formatted at 2026-08-12 11:25:28 on dist-test-slave-gjrz"
server_key: "d6fb11092dde904209a113e725e1124c"
server_key_iv: "adbb9ebf29e166b794302e304b37cd7c"
server_key_version: "encryptionkey@0"
I20260812 11:25:28.045707 23327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:28.071159 23327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:28.073642 23327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:28.073807 23327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:28.080242 23327 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:35827
I20260812 11:25:28.080278 23450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:35827 every 8 connection(s)
I20260812 11:25:28.081108 23327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:28.083711 23451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:28.088595 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23327
I20260812 11:25:28.088719 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:28.088958 12991 external_mini_cluster.cc:1428] Setting key fcd13b2307f4ba68238b39cd0fcb3866
I20260812 11:25:28.089401 23451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252: Bootstrap starting.
I20260812 11:25:28.091694 23451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:28.092383 23451 log.cc:824] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:28.094007 23451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252: No bootstrap required, opened a new log
Aug 12 11:25:28 dist-test-slave-gjrz krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:28.097517 23451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89e958db3f304d7cb80524b111fc6252" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35827 } }
I20260812 11:25:28.097775 23451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:28.097831 23451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89e958db3f304d7cb80524b111fc6252, State: Initialized, Role: FOLLOWER
I20260812 11:25:28.098270 23451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89e958db3f304d7cb80524b111fc6252" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35827 } }
I20260812 11:25:28.098417 23451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:28.098486 23451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:28.098582 23451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:28.099363 23451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89e958db3f304d7cb80524b111fc6252" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35827 } }
I20260812 11:25:28.099694 23451 leader_election.cc:302] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89e958db3f304d7cb80524b111fc6252; no voters:
I20260812 11:25:28.100020 23451 leader_election.cc:288] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:28.100106 23465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:28.100335 23465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [term 1 LEADER]: Becoming Leader. State: Replica: 89e958db3f304d7cb80524b111fc6252, State: Running, Role: LEADER
I20260812 11:25:28.100699 23465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89e958db3f304d7cb80524b111fc6252" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35827 } }
I20260812 11:25:28.101215 23451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:28.101809 23465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89e958db3f304d7cb80524b111fc6252. Latest consensus state: current_term: 1 leader_uuid: "89e958db3f304d7cb80524b111fc6252" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89e958db3f304d7cb80524b111fc6252" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35827 } } }
I20260812 11:25:28.102030 23465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:28.102278 23466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89e958db3f304d7cb80524b111fc6252" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89e958db3f304d7cb80524b111fc6252" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 35827 } } }
I20260812 11:25:28.102463 23476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:28.102494 23466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:28.102800 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:28.090232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41727 (local address 127.12.175.254:35827)
0812 11:25:28.090644 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:28.090659 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:28.090694 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:25:28.091334 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:28.091354 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:28.091675 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:28.091982 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:28.092771 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:28.093732 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:28.094619 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:28.095077 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:28.095234 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:28.097830 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:28.097837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:28.097856 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:28.097889 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:28.099542 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:28.100029 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:28.100035 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:28.100041 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:28.100203 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:28.100576 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:28.100586 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:28.100588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:28.101071 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:28.101265 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:28.101555 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 11:25:28.101839 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":133,"threads_started":1}
I20260812 11:25:28.105844 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:28.106145 23476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:28.111377 23476 catalog_manager.cc:1347] Generated new cluster ID: b441663a47f94e43bd82a71ca50a7548
I20260812 11:25:28.111467 23476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:28.119424 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:28.107852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54853 (local address 127.12.175.254:35827)
0812 11:25:28.107944 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:28.107948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:28.111554 (+ 3606us) server_negotiation.cc:407] Connection header received
0812 11:25:28.111735 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:28.111738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:28.111783 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:28.111867 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:28.112639 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:28.113359 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:28.114481 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:28.114820 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:28.114899 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:28.116424 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:28.116427 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:28.116429 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:28.116447 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:28.117909 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:28.118340 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:28.118344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:28.118345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:28.118417 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:28.118663 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:28.118666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:28.118668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:28.118836 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:28.118938 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:28.119156 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 11:25:28.119254 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:25:28.131883 23476 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:28.132654 23476 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:28.137137 23476 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89e958db3f304d7cb80524b111fc6252: Generated new TSK 0
I20260812 11:25:28.137745 23476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:28.148399 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23327
2026-08-12T11:25:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:28 dist-test-slave-gjrz krb5kdc[23514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:28 dist-test-slave-gjrz krb5kdc[23514](info): set up 2 sockets
Aug 12 11:25:28 dist-test-slave-gjrz krb5kdc[23514](info): commencing operation
krb5kdc: starting...
W20260812 11:25:29.342020 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:29 dist-test-slave-gjrz krb5kdc[23514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:29.452226 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39111
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:43323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:39111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:29.564884 23534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:29.565106 23534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:29.565143 23534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:29.568938 23534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:29.568980 23534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:29.568997 23534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:29.569011 23534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:29.569024 23534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:29.574303 23534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:43323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:39111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:39111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:29.575158 23534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:29.576026 23534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:29.583879 23547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:29.583914 23545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:29.584025 23534 server_base.cc:1034] running on GCE node
W20260812 11:25:29.583933 23549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:29.584638 23534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:29.585613 23534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:29.586766 23534 hybrid_clock.cc:648] HybridClock initialized: now 1786533929586753 us; error 26 us; skew 500 ppm
Aug 12 11:25:29 dist-test-slave-gjrz krb5kdc[23514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:29.589254 23534 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:29.590081 23534 webserver.cc:460] Webserver started at http://127.12.175.254:44145/ using document root <none> and password file <none>
I20260812 11:25:29.590569 23534 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:29.590637 23534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:29.590826 23534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:29.592769 23534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "2f29632479f744caade1835006df953f"
format_stamp: "Formatted at 2026-08-12 11:25:29 on dist-test-slave-gjrz"
server_key: "1542597e8dde7fd967e6a909e87abdd8"
server_key_iv: "3fb8380ea488a55df648b44479642f46"
server_key_version: "encryptionkey@0"
I20260812 11:25:29.593276 23534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "2f29632479f744caade1835006df953f"
format_stamp: "Formatted at 2026-08-12 11:25:29 on dist-test-slave-gjrz"
server_key: "1542597e8dde7fd967e6a909e87abdd8"
server_key_iv: "3fb8380ea488a55df648b44479642f46"
server_key_version: "encryptionkey@0"
I20260812 11:25:29.596621 23534 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:25:29.598737 23562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:29.599864 23534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:29.599979 23534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "2f29632479f744caade1835006df953f"
format_stamp: "Formatted at 2026-08-12 11:25:29 on dist-test-slave-gjrz"
server_key: "1542597e8dde7fd967e6a909e87abdd8"
server_key_iv: "3fb8380ea488a55df648b44479642f46"
server_key_version: "encryptionkey@0"
I20260812 11:25:29.600080 23534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:29.611928 23534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:29.614248 23534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:29.614393 23534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:29.620826 23534 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:39111
I20260812 11:25:29.620843 23672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:39111 every 8 connection(s)
I20260812 11:25:29.621634 23534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:29.624225 23673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:29.627902 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23534
I20260812 11:25:29.628047 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:29.628348 12991 external_mini_cluster.cc:1428] Setting key 3f687354a7f455f34dcc8323c25097f2
I20260812 11:25:29.629797 23673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f: Bootstrap starting.
I20260812 11:25:29.632011 23673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:29.632772 23673 log.cc:824] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:29.634699 23673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f: No bootstrap required, opened a new log
I20260812 11:25:29.636596 23680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:29.629540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50019 (local address 127.12.175.254:39111)
0812 11:25:29.629898 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:29.629918 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:29.629957 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:25:29.630554 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:29.630569 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:29.630880 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:29.631136 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:29.631498 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:29.632482 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:29.633551 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:29.634000 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:29.634119 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:29.634895 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:29.634900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:29.634911 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:29.635247 (+ 336us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:29.635338 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:29.635364 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:29.635435 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:29.635576 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:25:29.635758 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":97,"threads_started":1}
I20260812 11:25:29.637765 23673 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f29632479f744caade1835006df953f" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39111 } }
I20260812 11:25:29.638017 23673 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:29.638087 23673 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f29632479f744caade1835006df953f, State: Initialized, Role: FOLLOWER
I20260812 11:25:29.638491 23673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f29632479f744caade1835006df953f" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39111 } }
I20260812 11:25:29.638650 23673 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:29.638720 23673 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:29.638818 23673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:29.639241 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:29.639837 23673 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f29632479f744caade1835006df953f" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39111 } }
I20260812 11:25:29.640215 23673 leader_election.cc:302] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f29632479f744caade1835006df953f; no voters:
I20260812 11:25:29.640530 23673 leader_election.cc:288] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:29.640605 23684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:29.640862 23684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [term 1 LEADER]: Becoming Leader. State: Replica: 2f29632479f744caade1835006df953f, State: Running, Role: LEADER
I20260812 11:25:29.641204 23684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f29632479f744caade1835006df953f" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39111 } }
I20260812 11:25:29.641733 23673 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:29.642410 23684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f29632479f744caade1835006df953f. Latest consensus state: current_term: 1 leader_uuid: "2f29632479f744caade1835006df953f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f29632479f744caade1835006df953f" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39111 } } }
I20260812 11:25:29.642581 23684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:29.642794 23690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f29632479f744caade1835006df953f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f29632479f744caade1835006df953f" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 39111 } } }
I20260812 11:25:29.642892 23690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:29.643075 23704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:29.646116 23680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:29.641769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40781 (local address 127.12.175.254:39111)
0812 11:25:29.641858 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:29.641862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:29.642025 (+ 163us) server_negotiation.cc:407] Connection header received
0812 11:25:29.642067 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:29.642069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:29.642110 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:29.642186 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:29.642504 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:29.643223 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:29.644392 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:29.644728 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:29.644803 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:29.645687 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:29.645691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:29.645693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:29.645705 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:29.645731 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:29.645744 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:29.645806 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:29.645952 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:25:29.645999 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:25:29.646132 23704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:29.651085 23704 catalog_manager.cc:1347] Generated new cluster ID: 0d9548d6cb03446885e7b94626515b23
I20260812 11:25:29.651144 23704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:29.658319 23704 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:29.659453 23704 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:29.666227 23704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f29632479f744caade1835006df953f: Generated new TSK 0
I20260812 11:25:29.666882 23704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:29.678361 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23534
2026-08-12T11:25:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:29 dist-test-slave-gjrz krb5kdc[23729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:29 dist-test-slave-gjrz krb5kdc[23729](info): set up 2 sockets
Aug 12 11:25:29 dist-test-slave-gjrz krb5kdc[23729](info): commencing operation
krb5kdc: starting...
W20260812 11:25:30.875677 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:30 dist-test-slave-gjrz krb5kdc[23729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:30.987025 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:44659
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:31.100313 23748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:31.100544 23748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:31.100600 23748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:31.104496 23748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:31.104547 23748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:31.104574 23748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:31.104595 23748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:31.104625 23748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:31.109579 23748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:44659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:31.110474 23748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:31.111407 23748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:31.119398 23762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:31.119390 23759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:31.119506 23748 server_base.cc:1034] running on GCE node
W20260812 11:25:31.119398 23768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:31.120187 23748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:31.121169 23748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:31.122320 23748 hybrid_clock.cc:648] HybridClock initialized: now 1786533931122308 us; error 25 us; skew 500 ppm
Aug 12 11:25:31 dist-test-slave-gjrz krb5kdc[23729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533931, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:31.124861 23748 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:31.125655 23748 webserver.cc:460] Webserver started at http://127.12.175.254:40711/ using document root <none> and password file <none>
I20260812 11:25:31.126154 23748 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:31.126219 23748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:31.126391 23748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:31.128296 23748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "e1a3966da868470b8ae22d5290336517"
format_stamp: "Formatted at 2026-08-12 11:25:31 on dist-test-slave-gjrz"
server_key: "2b9cde6492f823c717ff90beddba8145"
server_key_iv: "ea89da0d33d9245f50761ace15e1eec2"
server_key_version: "encryptionkey@0"
I20260812 11:25:31.128808 23748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "e1a3966da868470b8ae22d5290336517"
format_stamp: "Formatted at 2026-08-12 11:25:31 on dist-test-slave-gjrz"
server_key: "2b9cde6492f823c717ff90beddba8145"
server_key_iv: "ea89da0d33d9245f50761ace15e1eec2"
server_key_version: "encryptionkey@0"
I20260812 11:25:31.132205 23748 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:25:31.134325 23790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:31.135457 23748 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:25:31.135572 23748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "e1a3966da868470b8ae22d5290336517"
format_stamp: "Formatted at 2026-08-12 11:25:31 on dist-test-slave-gjrz"
server_key: "2b9cde6492f823c717ff90beddba8145"
server_key_iv: "ea89da0d33d9245f50761ace15e1eec2"
server_key_version: "encryptionkey@0"
I20260812 11:25:31.135659 23748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:31.141968 23748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:31.144757 23748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:31.144922 23748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:31.151214 23748 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:44659
I20260812 11:25:31.151257 23894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:44659 every 8 connection(s)
I20260812 11:25:31.152052 23748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:31.154646 23897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:31.160038 23897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517: Bootstrap starting.
I20260812 11:25:31.162122 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23748
I20260812 11:25:31.162258 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:31.162542 12991 external_mini_cluster.cc:1428] Setting key 01b6f44eb8d209ed3dd5ba94f790ab6f
I20260812 11:25:31.162598 23897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:31.163452 23897 log.cc:824] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:31.165669 23897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517: No bootstrap required, opened a new log
I20260812 11:25:31.167689 23902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:31.163688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46985 (local address 127.12.175.254:44659)
0812 11:25:31.164058 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:31.164074 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:31.164108 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:25:31.164867 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:31.164891 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:31.165229 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:31.165572 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:31.166233 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:31.166239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:31.166253 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:31.166264 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:31.166324 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:31.166348 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:31.166445 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:31.166545 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 11:25:31.166699 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":107,"threads_started":1}
I20260812 11:25:31.169865 23897 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a3966da868470b8ae22d5290336517" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44659 } }
I20260812 11:25:31.170095 23897 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:25:31.170171 23897 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a3966da868470b8ae22d5290336517, State: Initialized, Role: FOLLOWER
I20260812 11:25:31.170459 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:31.170579 23897 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a3966da868470b8ae22d5290336517" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44659 } }
I20260812 11:25:31.170727 23897 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:25:31.170782 23897 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:25:31.170867 23897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:31.171904 23897 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a3966da868470b8ae22d5290336517" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44659 } }
I20260812 11:25:31.172267 23897 leader_election.cc:302] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1a3966da868470b8ae22d5290336517; no voters:
I20260812 11:25:31.172578 23897 leader_election.cc:288] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:25:31.172676 23909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:31.172935 23909 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [term 1 LEADER]: Becoming Leader. State: Replica: e1a3966da868470b8ae22d5290336517, State: Running, Role: LEADER
I20260812 11:25:31.173280 23909 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a3966da868470b8ae22d5290336517" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44659 } }
I20260812 11:25:31.173866 23897 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:31.174674 23902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:31.172707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57881 (local address 127.12.175.254:44659)
0812 11:25:31.172804 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:31.172808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:31.173040 (+ 232us) server_negotiation.cc:407] Connection header received
0812 11:25:31.173216 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:31.173219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:31.173254 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:31.173337 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:31.174018 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:31.174021 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:31.174024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:25:31.174035 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:31.174061 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:25:31.174073 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:31.174146 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:31.174519 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 11:25:31.174558 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:25:31.174901 23912 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1a3966da868470b8ae22d5290336517. Latest consensus state: current_term: 1 leader_uuid: "e1a3966da868470b8ae22d5290336517" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a3966da868470b8ae22d5290336517" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44659 } } }
I20260812 11:25:31.175014 23912 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:31.175346 23913 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1a3966da868470b8ae22d5290336517" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a3966da868470b8ae22d5290336517" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44659 } } }
I20260812 11:25:31.175441 23913 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517 [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:31.175752 23929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:31.178440 23929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:31.183110 23929 catalog_manager.cc:1347] Generated new cluster ID: 1d618152cffe4081a2ada3a9e78f3407
I20260812 11:25:31.183187 23929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:31.202329 23929 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:31.202589 23929 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:31.208038 23929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1a3966da868470b8ae22d5290336517: Generated new TSK 0
I20260812 11:25:31.208575 23929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:25:31.218595 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23748
2026-08-12T11:25:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1537 ms)
[----------] 18 tests from AuthTokenIssuingTest (27851 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:31 dist-test-slave-gjrz krb5kdc[23950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:31 dist-test-slave-gjrz krb5kdc[23950](info): set up 2 sockets
Aug 12 11:25:31 dist-test-slave-gjrz krb5kdc[23950](info): commencing operation
krb5kdc: starting...
W20260812 11:25:32.405655 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:32.518975 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45317
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:45317,127.12.175.253:41017,127.12.175.252:34903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:32.624083 23990 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:25:32.624320 23990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:32.624361 23990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:32.624420 23990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:32.628262 23990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:32.628310 23990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:32.628335 23990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:32.628369 23990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:32.628392 23990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:32.633332 23990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:45317,127.12.175.253:41017,127.12.175.252:34903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:45317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:32.634204 23990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:32.635092 23990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:32.642799 24002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:32.642871 24003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:32.642912 23990 server_base.cc:1034] running on GCE node
W20260812 11:25:32.643036 24006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:32.643550 23990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:32.644526 23990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:32.645682 23990 hybrid_clock.cc:648] HybridClock initialized: now 1786533932645663 us; error 31 us; skew 500 ppm
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:32.648267 23990 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:32.649065 23990 webserver.cc:460] Webserver started at http://127.12.175.254:37365/ using document root <none> and password file <none>
I20260812 11:25:32.649587 23990 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:32.649652 23990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:32.649842 23990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:32.651824 23990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "48f28c88bcbe474ea7837aac4b879baf"
format_stamp: "Formatted at 2026-08-12 11:25:32 on dist-test-slave-gjrz"
server_key: "611352798ebfce207d71490a978e864b"
server_key_iv: "57d05ecce16a12bd040fa11c9a7f636c"
server_key_version: "encryptionkey@0"
I20260812 11:25:32.652343 23990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "48f28c88bcbe474ea7837aac4b879baf"
format_stamp: "Formatted at 2026-08-12 11:25:32 on dist-test-slave-gjrz"
server_key: "611352798ebfce207d71490a978e864b"
server_key_iv: "57d05ecce16a12bd040fa11c9a7f636c"
server_key_version: "encryptionkey@0"
I20260812 11:25:32.655841 23990 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:25:32.657965 24021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:32.659011 23990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:25:32.659128 23990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "48f28c88bcbe474ea7837aac4b879baf"
format_stamp: "Formatted at 2026-08-12 11:25:32 on dist-test-slave-gjrz"
server_key: "611352798ebfce207d71490a978e864b"
server_key_iv: "57d05ecce16a12bd040fa11c9a7f636c"
server_key_version: "encryptionkey@0"
I20260812 11:25:32.659216 23990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:32.670463 23990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:32.673002 23990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:32.673170 23990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:32.679418 23990 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:45317
I20260812 11:25:32.679705 24125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:45317 every 8 connection(s)
I20260812 11:25:32.680346 23990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:32.682847 24126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:32.683712 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 23990
I20260812 11:25:32.683821 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:32.684060 12991 external_mini_cluster.cc:1428] Setting key 4b397853a495e40a575b6320bda4ac61
I20260812 11:25:32.686527 24126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.253@KRBTEST.COM" created.
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:32.700917 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.688883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45317 (local address 127.0.0.1:35038)
0812 11:25:32.689341 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.689391 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:32.690248 (+ 857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:32.690973 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:32.690977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:32.691318 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:32.691586 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.691600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.693189 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.693192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.694003 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.694014 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.694597 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.694600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.694700 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.695214 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:32.695230 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:32.696640 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:32.698261 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.698270 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.698279 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.698481 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.698764 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.698767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.698769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.698871 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.699415 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:32.699420 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:32.699546 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 11:25:32.699686 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 11:25:32.700030 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":101,"thread_start_us":119,"threads_started":1}
I20260812 11:25:32.700917 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.689725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35038 (local address 127.12.175.254:45317)
0812 11:25:32.690030 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:32.690041 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:32.690087 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:25:32.690544 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:32.690550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:32.690792 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:32.690996 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:32.691740 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.693075 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.694121 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.694477 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.694599 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.696767 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:32.696773 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:32.696782 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:32.696801 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:32.698166 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.698576 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.698587 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.698588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.698684 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.698948 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.698952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.698953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.699310 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:32.699420 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:32.699767 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 11:25:32.699972 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":200,"thread_start_us":89,"threads_started":1}
I20260812 11:25:32.703758 24126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:32.704375 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.704145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55920)
0812 11:25:32.704249 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.704314 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 11:25:32.704563 24024 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
I20260812 11:25:32.705309 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.705114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55936)
0812 11:25:32.705213 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.705257 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 11:25:32.705497 24126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:41017: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab.
Entry for principal kudu/127.12.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab.
I20260812 11:25:32.710071 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:41017
--webserver_interface=127.12.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab
--principal=kudu/127.12.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:45317,127.12.175.253:41017,127.12.175.252:34903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:25:32.754750 24126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } attempt: 1
I20260812 11:25:32.755601 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.755329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55942)
0812 11:25:32.755465 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.755524 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 11:25:32.756320 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.756115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55946)
0812 11:25:32.756214 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.756259 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:25:32.756436 24126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:41017: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
W20260812 11:25:32.815534 24138 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:25:32.815758 24138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:32.815785 24138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:32.815825 24138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:32.819619 24138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:32.819664 24138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:32.819680 24138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:32.819698 24138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:32.819717 24138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:32.824595 24138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:45317,127.12.175.253:41017,127.12.175.252:34903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab
--principal=kudu/127.12.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:41017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:32.824573 24126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } attempt: 2
I20260812 11:25:32.825353 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.825031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55958)
0812 11:25:32.825197 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.825268 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:25:32.825578 24138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:32.826051 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.825818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55960)
0812 11:25:32.825929 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.825984 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 11:25:32.826193 24126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:41017: Network error: Client connection negotiation failed: client connection to 127.12.175.253:41017: connect: Connection refused (error 111)
I20260812 11:25:32.826601 24138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:32.834268 24146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:32.834270 24148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:32.834327 24143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:32.834501 24138 server_base.cc:1034] running on GCE node
I20260812 11:25:32.835052 24138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:32.836045 24138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:32.837201 24138 hybrid_clock.cc:648] HybridClock initialized: now 1786533932837183 us; error 24 us; skew 500 ppm
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:32.842792 24138 init.cc:377] Logged in from keytab as kudu/127.12.175.253@KRBTEST.COM (short username kudu)
I20260812 11:25:32.843727 24138 webserver.cc:460] Webserver started at http://127.12.175.253:43051/ using document root <none> and password file <none>
I20260812 11:25:32.844231 24138 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:32.844297 24138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:32.844496 24138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:32.846591 24138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data/instance:
uuid: "9324650df81042688926a3b1007343a4"
format_stamp: "Formatted at 2026-08-12 11:25:32 on dist-test-slave-gjrz"
server_key: "e827fc88a3745684c56d4eb0119d192e"
server_key_iv: "615b395df207fe2c1b4c5f3b6a60d75e"
server_key_version: "encryptionkey@0"
I20260812 11:25:32.847136 24138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal/instance:
uuid: "9324650df81042688926a3b1007343a4"
format_stamp: "Formatted at 2026-08-12 11:25:32 on dist-test-slave-gjrz"
server_key: "e827fc88a3745684c56d4eb0119d192e"
server_key_iv: "615b395df207fe2c1b4c5f3b6a60d75e"
server_key_version: "encryptionkey@0"
I20260812 11:25:32.850667 24138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:25:32.852965 24160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:32.854017 24138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 11:25:32.854128 24138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal
uuid: "9324650df81042688926a3b1007343a4"
format_stamp: "Formatted at 2026-08-12 11:25:32 on dist-test-slave-gjrz"
server_key: "e827fc88a3745684c56d4eb0119d192e"
server_key_iv: "615b395df207fe2c1b4c5f3b6a60d75e"
server_key_version: "encryptionkey@0"
I20260812 11:25:32.854223 24138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:32.878832 24138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:32.881274 24138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:32.881430 24138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:32.887879 24138 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.253:41017
I20260812 11:25:32.888120 24271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.253:41017 every 8 connection(s)
I20260812 11:25:32.888751 24138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
I20260812 11:25:32.891285 24274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:32.894675 24274 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:32.895252 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24138
I20260812 11:25:32.895381 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-1/wal/instance
I20260812 11:25:32.895623 12991 external_mini_cluster.cc:1428] Setting key c20dd6a2895e7caeef47649a3bb73304
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.252@KRBTEST.COM" created.
I20260812 11:25:32.906950 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.896407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35050 (local address 127.12.175.254:45317)
0812 11:25:32.896547 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:32.896552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:32.897288 (+ 736us) server_negotiation.cc:407] Connection header received
0812 11:25:32.898185 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:32.898188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:32.898248 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:32.898316 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:32.899396 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.899922 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.900999 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.901241 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.901328 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.903572 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:32.903575 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:32.903577 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:32.903612 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:32.904920 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.905378 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.905381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.905382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.905498 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.905841 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.905844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.905846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.906080 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:32.906177 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:32.906671 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 11:25:32.906793 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:25:32.907753 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.896709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45317 (local address 127.0.0.1:35050)
0812 11:25:32.897139 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.897188 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:32.897977 (+ 789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:32.898479 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:32.898485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:32.898791 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:32.899232 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.899245 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.900038 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.900041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.900883 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.900892 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.901373 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.901377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.901526 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.902073 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:32.902099 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:32.903424 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:32.905023 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.905029 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.905042 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.905285 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.905620 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.905624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.905626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.905753 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.906186 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:32.906192 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:32.906431 (+ 239us) client_negotiation.cc:769] Sending connection context
0812 11:25:32.906587 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 11:25:32.906870 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":104,"threads_started":1}
I20260812 11:25:32.909169 24274 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:32.917353 24126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } attempt: 3
I20260812 11:25:32.919400 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.909640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55974)
0812 11:25:32.909779 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.909789 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:32.909844 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:32.910321 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:32.910324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:32.910475 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:32.910552 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.910561 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.911513 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.911516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.912035 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.912043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.912590 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.912593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.912674 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.913098 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:32.913108 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:32.915992 (+ 2884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:32.917702 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.917706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.917707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.917936 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.918267 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.918271 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.918273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.918372 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.918820 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:32.918823 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:32.918924 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 11:25:32.919063 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 11:25:32.919217 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 11:25:32.919499 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.909734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.12.175.253:41017)
0812 11:25:32.910010 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:32.910020 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:32.910036 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:25:32.910066 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:32.910069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:32.910211 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:32.910320 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:32.910657 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.911417 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.912136 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.912486 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.912572 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.916132 (+ 3560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:32.916141 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:32.916152 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:32.916174 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:32.917601 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.918058 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.918063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.918065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.918166 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.918460 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.918463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.918464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.918719 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:32.918825 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:32.919156 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 11:25:32.919316 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab.
Entry for principal kudu/127.12.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab.
I20260812 11:25:32.921195 24274 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:32.921975 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.921615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43362)
0812 11:25:32.921769 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.921909 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260812 11:25:32.922113 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:34903
--webserver_interface=127.12.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab
--principal=kudu/127.12.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:41489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:45317,127.12.175.253:41017,127.12.175.252:34903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:32.922142 24163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
I20260812 11:25:32.922958 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.922745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43372)
0812 11:25:32.922845 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.922898 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 11:25:32.923087 24274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:34903: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Aug 12 11:25:32 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:32.926569 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.917823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55982 (local address 127.12.175.253:41017)
0812 11:25:32.918128 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:32.918137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:32.918149 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:25:32.918180 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:32.918183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:32.918221 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:32.918296 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:32.919144 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.919849 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.920735 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.921516 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.921621 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.923771 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:32.923775 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:32.923778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:32.923799 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:32.925072 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.925520 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.925522 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.925523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.925591 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:32.925848 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:32.925850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:32.925851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:32.925990 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:32.926056 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:32.926358 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 11:25:32.926448 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":89,"threads_started":1}
I20260812 11:25:32.926614 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.917788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55982)
0812 11:25:32.917920 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.917934 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:32.918011 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:32.918332 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:32.918335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:32.918503 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:32.919012 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.919023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.919947 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.919950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.920605 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:32.920642 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:32.921641 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:32.921645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:32.921761 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:32.922224 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:32.922239 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:32.923641 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:32.925195 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.925198 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.925200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.925437 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.925670 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:32.925673 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:32.925675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:32.925767 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:32.926066 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:32.926069 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:32.926192 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 11:25:32.926318 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 11:25:32.926462 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:25:32.927348 24126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:32.927959 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.927753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43380)
0812 11:25:32.927859 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.927903 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 11:25:32.928607 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.928377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43392)
0812 11:25:32.928507 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.928550 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 11:25:32.928721 24126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:34903: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
I20260812 11:25:32.959862 24126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } attempt: 1
I20260812 11:25:32.960618 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.960325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43402)
0812 11:25:32.960464 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.960524 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:25:32.961362 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.961133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43410)
0812 11:25:32.961242 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.961296 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 11:25:32.961571 24126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:34903: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
I20260812 11:25:32.979318 24274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } attempt: 1
I20260812 11:25:32.980082 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.979769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43426)
0812 11:25:32.979947 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.980000 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260812 11:25:32.980839 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:32.980595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43436)
0812 11:25:32.980732 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:32.980776 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260812 11:25:32.980959 24274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:34903: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
I20260812 11:25:33.036731 24126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } attempt: 2
I20260812 11:25:33.037510 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.037234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43446)
0812 11:25:33.037376 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.037433 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:25:33.038219 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.038006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43448)
0812 11:25:33.038116 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.038161 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 11:25:33.038395 24126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:34903: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
I20260812 11:25:33.049103 24274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } attempt: 2
I20260812 11:25:33.049754 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.049513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43452)
0812 11:25:33.049635 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.049687 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 11:25:33.050485 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.050297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43466)
0812 11:25:33.050383 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.050431 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 11:25:33.050649 24274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:34903: Network error: Client connection negotiation failed: client connection to 127.12.175.252:34903: connect: Connection refused (error 111)
W20260812 11:25:33.060616 24295 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:25:33.061012 24295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:33.061061 24295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:33.061127 24295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:33.067095 24295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:33.067163 24295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:33.067202 24295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:33.067234 24295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:33.067281 24295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:33.074281 24295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:41489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:45317,127.12.175.253:41017,127.12.175.252:34903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab
--principal=kudu/127.12.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:34903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:33.075233 24295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:33.076218 24295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:33.084313 24307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:33.084374 24312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:33.084349 24308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:33.084568 24295 server_base.cc:1034] running on GCE node
I20260812 11:25:33.085114 24295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:33.086124 24295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:33.087291 24295 hybrid_clock.cc:648] HybridClock initialized: now 1786533933087263 us; error 40 us; skew 500 ppm
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:33.089718 24295 init.cc:377] Logged in from keytab as kudu/127.12.175.252@KRBTEST.COM (short username kudu)
I20260812 11:25:33.090488 24295 webserver.cc:460] Webserver started at http://127.12.175.252:45623/ using document root <none> and password file <none>
I20260812 11:25:33.091008 24295 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:33.091071 24295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:33.091244 24295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:33.093102 24295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data/instance:
uuid: "d9628feca5c24540aaf0c6a1ee190584"
format_stamp: "Formatted at 2026-08-12 11:25:33 on dist-test-slave-gjrz"
server_key: "29ff6386cc2e010ebfed3cb95aafc6a6"
server_key_iv: "e4e2f305712d781578c0ee13cedc2515"
server_key_version: "encryptionkey@0"
I20260812 11:25:33.093606 24295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal/instance:
uuid: "d9628feca5c24540aaf0c6a1ee190584"
format_stamp: "Formatted at 2026-08-12 11:25:33 on dist-test-slave-gjrz"
server_key: "29ff6386cc2e010ebfed3cb95aafc6a6"
server_key_iv: "e4e2f305712d781578c0ee13cedc2515"
server_key_version: "encryptionkey@0"
I20260812 11:25:33.097031 24295 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:25:33.099154 24322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:33.100271 24295 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:25:33.100378 24295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal
uuid: "d9628feca5c24540aaf0c6a1ee190584"
format_stamp: "Formatted at 2026-08-12 11:25:33 on dist-test-slave-gjrz"
server_key: "29ff6386cc2e010ebfed3cb95aafc6a6"
server_key_iv: "e4e2f305712d781578c0ee13cedc2515"
server_key_version: "encryptionkey@0"
I20260812 11:25:33.100462 24295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:33.111881 24295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:33.114226 24295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:33.114380 24295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:33.120615 24295 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.252:34903
I20260812 11:25:33.120913 24426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.252:34903 every 8 connection(s)
I20260812 11:25:33.121433 24295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
I20260812 11:25:33.124013 24427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:33.127445 24427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:33.131006 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24295
I20260812 11:25:33.131112 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533654564615-12991-0/minicluster-data/master-2/wal/instance
I20260812 11:25:33.131377 12991 external_mini_cluster.cc:1428] Setting key 03d549ace6042b2495c716937085ec8c
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:33.137544 24126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } attempt: 3
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:25:33.142275 24274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } attempt: 3
I20260812 11:25:33.142818 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.131975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43478 (local address 127.12.175.252:34903)
0812 11:25:33.132246 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.132257 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.132462 (+ 205us) server_negotiation.cc:407] Connection header received
0812 11:25:33.132612 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.132632 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.132809 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.132970 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.133580 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.134584 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.135572 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.136080 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.136189 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.138715 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.138722 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.138734 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.138761 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.140729 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.141229 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.141235 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.141236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.141331 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.141591 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.141594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.141596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.141910 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.142133 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.142329 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.142611 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":187,"thread_start_us":112,"threads_started":1}
I20260812 11:25:33.142838 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.129065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35054 (local address 127.12.175.254:45317)
0812 11:25:33.129202 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.129206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.129887 (+ 681us) server_negotiation.cc:407] Connection header received
0812 11:25:33.130742 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.130746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.130824 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.130892 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.132243 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.132873 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.134395 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.134621 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.134718 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.137309 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.137314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.137317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.137345 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.138949 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.139612 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.139615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.139617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.139706 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.140071 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.140075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.140077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.140318 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.140421 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.142592 (+ 2171us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.142707 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:25:33.142967 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.129363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:45317 (local address 127.0.0.1:35054)
0812 11:25:33.129753 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.129791 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:33.130549 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:33.131059 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:33.131066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:33.131472 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:33.132054 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.132074 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.133019 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.133022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.134275 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.134286 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.134754 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.134757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.134897 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.135423 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:33.135439 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:33.137155 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:33.139066 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.139074 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.139081 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.139504 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.139807 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.139809 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.139810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.139958 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.140422 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:33.140428 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:33.140688 (+ 260us) client_negotiation.cc:769] Sending connection context
0812 11:25:33.140834 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 11:25:33.141118 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":75,"thread_start_us":105,"threads_started":1}
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:25:33.144294 24427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:33.149226 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.137961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43488)
0812 11:25:33.138108 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.138122 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:33.138411 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:33.139612 (+ 1201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:33.139615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:33.139783 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:33.139869 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.139874 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.140605 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.140609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.141201 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.141213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.141798 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.141802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.141899 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.142295 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:33.142308 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:33.144038 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:33.147564 (+ 3526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.147567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.147569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.147818 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.148117 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.148120 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.148122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.148209 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.148769 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:33.148773 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:33.148872 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 11:25:33.148956 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:25:33.149078 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 11:25:33.149832 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.138185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43488 (local address 127.12.175.252:34903)
0812 11:25:33.139430 (+ 1245us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.139437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.139448 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:25:33.139473 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.139475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.139506 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.139597 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.139968 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.140504 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.141324 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.141680 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.141811 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.144615 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.144619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.144622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.144646 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.147445 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.147929 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.147932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.147934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.148014 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.148309 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.148312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.148340 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.148650 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.149477 (+ 827us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.149553 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.149671 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":73,"server-negotiator.queue_time_us":1188,"spinlock_wait_cycles":4224,"thread_start_us":92,"threads_started":1}
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:33.152653 24126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: Bootstrap starting.
I20260812 11:25:33.155424 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.145485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35068 (local address 127.12.175.254:45317)
0812 11:25:33.145575 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.145578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.145790 (+ 212us) server_negotiation.cc:407] Connection header received
0812 11:25:33.145947 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.145949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.145987 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.146033 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.146876 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.147564 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.148575 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.148895 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.148961 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.152343 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.152346 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.152349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.152374 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.153775 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154152 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.154155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.154157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.154231 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154475 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.154478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.154480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.154647 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.154814 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.155153 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.155289 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:25:33.155416 24126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:33.155870 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.142669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43496)
0812 11:25:33.142838 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.142851 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:33.142926 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:33.145741 (+ 2815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:33.145744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:33.145922 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:33.146024 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.146031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.147473 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.147476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.148271 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.148282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.148975 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.148978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.149058 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.149457 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:33.149472 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:33.151241 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:33.153294 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.153297 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.153299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.154258 (+ 959us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.154863 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.154868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.154955 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.155422 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:33.155425 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:33.155520 (+ 95us) client_negotiation.cc:769] Sending connection context
0812 11:25:33.155603 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 11:25:33.155729 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260812 11:25:33.155965 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.144707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:41017 (local address 127.0.0.1:55990)
0812 11:25:33.145076 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.145088 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:33.145157 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:33.145467 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:33.145470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:33.145619 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:33.145712 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.145719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.146788 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.146793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.147586 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.147594 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.148447 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.148453 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.148576 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.148968 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:33.148981 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:33.151781 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:33.154352 (+ 2571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154355 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.154357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.154573 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.154869 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.154874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.154963 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.155506 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:33.155509 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:33.155598 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 11:25:33.155713 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 11:25:33.155829 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":4,"spinlock_wait_cycles":1920}
I20260812 11:25:33.156368 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.143149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.12.175.252:34903)
0812 11:25:33.145497 (+ 2348us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.145505 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.145518 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:25:33.145551 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.145554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.145592 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.146139 (+ 547us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.146270 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.147357 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.148507 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.148852 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.149465 (+ 613us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.151422 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.151425 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.151428 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.151452 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.153175 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154681 (+ 1506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.154683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.154685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.154762 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.155061 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.155064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.155065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.155304 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.156019 (+ 715us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.156106 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.156209 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2288,"thread_start_us":73,"threads_started":1}
I20260812 11:25:33.156409 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.144913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55990 (local address 127.12.175.253:41017)
0812 11:25:33.145005 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.145009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.145225 (+ 216us) server_negotiation.cc:407] Connection header received
0812 11:25:33.145265 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.145267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.145307 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.145366 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.145839 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.146497 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.147704 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.148067 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.148147 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.151962 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.151965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.151968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.151991 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.154055 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.154675 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.154679 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.154680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.154764 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.155072 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.155076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.155077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.155367 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.155460 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.156149 (+ 689us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.156270 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":36}
I20260812 11:25:33.157092 24427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:33.158087 24126 log.cc:824] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:33.159564 24274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: Bootstrap starting.
I20260812 11:25:33.160272 24126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: No bootstrap required, opened a new log
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:33.162482 24274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:33.163424 24274 log.cc:824] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:33.164471 24126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.164790 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.156866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55998 (local address 127.12.175.253:41017)
0812 11:25:33.156971 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.156975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.156986 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:25:33.157051 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.157054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.157102 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.157178 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.157777 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.158343 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.159227 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.159547 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.159638 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.161811 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.161814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.161817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.161841 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.163078 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.163539 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.163543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.163545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.163640 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.163888 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.163892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.163893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.164051 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.164209 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.164548 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.164657 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:25:33.164790 24126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f28c88bcbe474ea7837aac4b879baf, State: Initialized, Role: FOLLOWER
I20260812 11:25:33.165133 24126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.166435 24126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:33.166831 24274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: No bootstrap required, opened a new log
Aug 12 11:25:33 dist-test-slave-gjrz krb5kdc[23950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:25:33.168097 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:33.169700 24068 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "48f28c88bcbe474ea7837aac4b879baf"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35068
I20260812 11:25:33.169905 24068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:25:33.170011 24068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:33.170766 24274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.170964 24274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9324650df81042688926a3b1007343a4, State: Initialized, Role: FOLLOWER
I20260812 11:25:33.171140 24068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.171365 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.159636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:34903 (local address 127.0.0.1:43504)
0812 11:25:33.159890 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:33.159903 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:33.159973 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:33.164158 (+ 4185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:33.164161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:33.164311 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:33.164395 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.164401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.165271 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.165274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.165936 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:33.165946 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.166467 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.166470 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:33.166542 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.166942 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:33.166955 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:33.168282 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:33.170047 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.170050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.170051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.170275 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.170483 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:33.170486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:33.170488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:33.170559 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:33.170878 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:33.170881 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:33.170979 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 11:25:33.171071 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:25:33.171193 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203}
I20260812 11:25:33.171300 24274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.171387 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.159806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43504 (local address 127.12.175.252:34903)
0812 11:25:33.163945 (+ 4139us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.163949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.163964 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:25:33.163997 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.164000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.164037 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.164118 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.164499 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.165168 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.166049 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.166355 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.166734 (+ 379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.168409 (+ 1675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.168412 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.168414 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.168433 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.169952 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.170350 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.170352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.170353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.170404 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.170638 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.170641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.170642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.170793 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.170873 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.171115 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.171247 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":4070}
I20260812 11:25:33.172066 24068 leader_election.cc:288] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [CANDIDATE]: Term 1 election: Requested vote from peers 9324650df81042688926a3b1007343a4 (127.12.175.253:41017), d9628feca5c24540aaf0c6a1ee190584 (127.12.175.252:34903)
I20260812 11:25:33.172593 24274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:33.172945 24215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48f28c88bcbe474ea7837aac4b879baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9324650df81042688926a3b1007343a4"
I20260812 11:25:33.173146 24215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:33.174454 24427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: Bootstrap starting.
I20260812 11:25:33.175071 24215 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f28c88bcbe474ea7837aac4b879baf in term 1.
W20260812 11:25:33.175390 24031 tablet.cc:2369] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:25:33.175951 24024 leader_election.cc:302] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f28c88bcbe474ea7837aac4b879baf, 9324650df81042688926a3b1007343a4; no voters:
W20260812 11:25:33.177642 24475 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 11:25:33.178007 24427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:33.178241 24476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.178439 24476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.178808 24427 log.cc:824] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:33.178687 24445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
W20260812 11:25:33.179320 24475 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:33.179409 24445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.179575 24445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:33.179648 24445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [term 1 LEADER]: Becoming Leader. State: Replica: 48f28c88bcbe474ea7837aac4b879baf, State: Running, Role: LEADER
I20260812 11:25:33.179916 24445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.181627 24445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48f28c88bcbe474ea7837aac4b879baf. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.181736 24445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:33.179943 23990 master_runner.cc:186] Error getting master registration for 127.12.175.252:34903: OK, instance_id { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" instance_seqno: 1786533933118832 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:25:33.183097 23990 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:25:33.180968 24138 master_runner.cc:186] Error getting master registration for 127.12.175.252:34903: OK, instance_id { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" instance_seqno: 1786533933118832 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:25:33.184134 24138 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:25:33.185801 24427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: No bootstrap required, opened a new log
W20260812 11:25:33.186059 24512 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:33.186138 24512 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:33.188230 24522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:33.189128 24522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:33.191627 24427 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.191926 24427 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9628feca5c24540aaf0c6a1ee190584, State: Initialized, Role: FOLLOWER
I20260812 11:25:33.192282 24427 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } }
I20260812 11:25:33.193235 24531 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.193439 24531 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.193728 24427 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:33.193774 24381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48f28c88bcbe474ea7837aac4b879baf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d9628feca5c24540aaf0c6a1ee190584"
I20260812 11:25:33.194013 24381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:33.195343 24381 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f28c88bcbe474ea7837aac4b879baf in term 1.
W20260812 11:25:33.199731 24554 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:33.199810 24554 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:33.202092 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.184843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35072 (local address 127.12.175.254:45317)
0812 11:25:33.184942 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.184946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.187235 (+ 2289us) server_negotiation.cc:407] Connection header received
0812 11:25:33.188488 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.188491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.188538 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.188586 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.191541 (+ 2955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.192247 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.193315 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.193608 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.193696 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.196017 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.196020 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.196023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.196050 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.197576 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.200289 (+ 2713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.200292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.200294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.200389 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.200694 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.200698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.200699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.200905 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.201024 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.201810 (+ 786us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.201945 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:25:33.203554 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.185275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56008 (local address 127.12.175.253:41017)
0812 11:25:33.185371 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.185375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.186897 (+ 1522us) server_negotiation.cc:407] Connection header received
0812 11:25:33.187331 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.187334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.187382 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.187432 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.189504 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.190271 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.191527 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.191859 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.191971 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.197226 (+ 5255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.197229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.197232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.197258 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.198724 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.200048 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.200052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.200054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.200145 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.200432 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.200436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.200437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.200653 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.200764 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.203298 (+ 2534us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.203411 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:25:33.209826 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:33.186319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43514 (local address 127.12.175.252:34903)
0812 11:25:33.186416 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.186419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.201414 (+ 14995us) server_negotiation.cc:407] Connection header received
0812 11:25:33.201450 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.201452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.201492 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.201554 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.202438 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.203094 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.204136 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:33.204466 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:33.204558 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:33.206111 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:33.206115 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:33.206118 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:33.206143 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:33.207715 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.208206 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.208210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.208211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.208297 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:33.208602 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:33.208605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:33.208607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:33.208812 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:33.208952 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:33.209578 (+ 626us) server_negotiation.cc:299] Negotiation successful
0812 11:25:33.209687 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:25:33.215662 24381 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [term 1 FOLLOWER]: Refusing update from remote peer 48f28c88bcbe474ea7837aac4b879baf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:33.216392 24215 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [term 1 FOLLOWER]: Refusing update from remote peer 48f28c88bcbe474ea7837aac4b879baf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:33.216964 24506 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:33.217398 24445 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:33.220762 24476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48f28c88bcbe474ea7837aac4b879baf. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.220862 24476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.221871 24531 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48f28c88bcbe474ea7837aac4b879baf. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.221994 24531 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.227108 24506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.227218 24506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:33.227504 24476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.227550 24530 mvcc.cc:205] Tried to move back new op lower bound from 7317642990443470848 to 7317642990308290560. Current Snapshot: MvccSnapshot[applied={T|T < 7317642990443470848}]
I20260812 11:25:33.227608 24476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.228047 24556 mvcc.cc:205] Tried to move back new op lower bound from 7317642990443470848 to 7317642990308290560. Current Snapshot: MvccSnapshot[applied={T|T < 7317642990443470848}]
I20260812 11:25:33.231587 24506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.231688 24506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:33.232687 24531 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "48f28c88bcbe474ea7837aac4b879baf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f28c88bcbe474ea7837aac4b879baf" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 45317 } } peers { permanent_uuid: "9324650df81042688926a3b1007343a4" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 41017 } } peers { permanent_uuid: "d9628feca5c24540aaf0c6a1ee190584" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 34903 } } }
I20260812 11:25:33.232785 24531 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:33.233419 24557 mvcc.cc:205] Tried to move back new op lower bound from 7317642990443470848 to 7317642990308290560. Current Snapshot: MvccSnapshot[applied={T|T < 7317642990443470848}]
I20260812 11:25:33.241546 24522 catalog_manager.cc:1347] Generated new cluster ID: e7c259df191f47be97354d112f972763
I20260812 11:25:33.241601 24522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:33.255640 24522 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:33.256807 24522 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:33.267316 24522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48f28c88bcbe474ea7837aac4b879baf: Generated new TSK 0
I20260812 11:25:33.268018 24522 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:25:33.298271 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.295330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56018 (local address 127.12.175.253:41017)
0812 11:25:33.295452 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.295457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.297013 (+ 1556us) server_negotiation.cc:407] Connection header received
0812 11:25:33.297447 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.297451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.297498 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.297546 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.298148 (+ 602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56018: BlockingRecv error: recv got EOF from 127.0.0.1:56018 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 11:25:33.299606 24134 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.296092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35082 (local address 127.12.175.254:45317)
0812 11:25:33.296199 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.296203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.298728 (+ 2525us) server_negotiation.cc:407] Connection header received
0812 11:25:33.298884 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.298887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.298931 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.298977 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.299498 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35082: BlockingRecv error: recv got EOF from 127.0.0.1:35082 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 11:25:33.300876 24437 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.296683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43524 (local address 127.12.175.252:34903)
0812 11:25:33.296787 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.296791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.299974 (+ 3183us) server_negotiation.cc:407] Connection header received
0812 11:25:33.300222 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.300225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.300268 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.300310 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.300768 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43524: BlockingRecv error: recv got EOF from 127.0.0.1:43524 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 11:25:33.305125 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.302988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56030 (local address 127.12.175.253:41017)
0812 11:25:33.303093 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.303097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.304148 (+ 1051us) server_negotiation.cc:407] Connection header received
0812 11:25:33.304434 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.304437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.304510 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.304559 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.305036 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56030: BlockingRecv error: recv got EOF from 127.0.0.1:56030 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 11:25:33.309788 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.308404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56036 (local address 127.12.175.253:41017)
0812 11:25:33.308493 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.308496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.309007 (+ 511us) server_negotiation.cc:407] Connection header received
0812 11:25:33.309171 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.309174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.309216 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.309260 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.309709 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56036: BlockingRecv error: recv got EOF from 127.0.0.1:56036 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 11:25:33.314865 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.313503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56038 (local address 127.12.175.253:41017)
0812 11:25:33.313588 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.313592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.314084 (+ 492us) server_negotiation.cc:407] Connection header received
0812 11:25:33.314249 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.314252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.314294 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.314339 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.314784 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56038: BlockingRecv error: recv got EOF from 127.0.0.1:56038 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 11:25:33.322016 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.320582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56052 (local address 127.12.175.253:41017)
0812 11:25:33.320710 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.320713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.321205 (+ 492us) server_negotiation.cc:407] Connection header received
0812 11:25:33.321370 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.321373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.321413 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.321457 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.321937 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56052: BlockingRecv error: recv got EOF from 127.0.0.1:56052 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260812 11:25:33.333431 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.331940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56064 (local address 127.12.175.253:41017)
0812 11:25:33.332033 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.332037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.332565 (+ 528us) server_negotiation.cc:407] Connection header received
0812 11:25:33.332761 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.332764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.332810 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.332857 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.333342 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56064: BlockingRecv error: recv got EOF from 127.0.0.1:56064 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 11:25:33.353343 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.351607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56066 (local address 127.12.175.253:41017)
0812 11:25:33.351735 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.351739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.352332 (+ 593us) server_negotiation.cc:407] Connection header received
0812 11:25:33.352551 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.352555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.352607 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.352683 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.353236 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56066: BlockingRecv error: recv got EOF from 127.0.0.1:56066 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 11:25:33.388491 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.387320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56078 (local address 127.12.175.253:41017)
0812 11:25:33.387436 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.387440 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.387693 (+ 253us) server_negotiation.cc:407] Connection header received
0812 11:25:33.387827 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.387830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.387874 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.387941 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.388382 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56078: BlockingRecv error: recv got EOF from 127.0.0.1:56078 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 11:25:33.455514 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.454358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56090 (local address 127.12.175.253:41017)
0812 11:25:33.454490 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.454494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.454645 (+ 151us) server_negotiation.cc:407] Connection header received
0812 11:25:33.454802 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.454805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.454852 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.454923 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.455405 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56090: BlockingRecv error: recv got EOF from 127.0.0.1:56090 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 11:25:33.586611 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.585407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56092 (local address 127.12.175.253:41017)
0812 11:25:33.585537 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.585541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.585707 (+ 166us) server_negotiation.cc:407] Connection header received
0812 11:25:33.585862 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.585865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.585916 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.585987 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.586487 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56092: BlockingRecv error: recv got EOF from 127.0.0.1:56092 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 11:25:33.845552 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:33.844596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56102 (local address 127.12.175.253:41017)
0812 11:25:33.844743 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:33.844746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:33.844808 (+ 62us) server_negotiation.cc:407] Connection header received
0812 11:25:33.844936 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:33.844938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:33.844987 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:33.845057 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:33.845431 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56102: BlockingRecv error: recv got EOF from 127.0.0.1:56102 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:25:34.187387 24512 catalog_manager.cc:1259] Loaded cluster ID: e7c259df191f47be97354d112f972763
I20260812 11:25:34.187474 24512 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: loading cluster ID for follower catalog manager: success
I20260812 11:25:34.189134 24512 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: acquiring CA information for follower catalog manager: success
I20260812 11:25:34.190248 24512 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9324650df81042688926a3b1007343a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:25:34.200830 24554 catalog_manager.cc:1259] Loaded cluster ID: e7c259df191f47be97354d112f972763
I20260812 11:25:34.200901 24554 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: loading cluster ID for follower catalog manager: success
I20260812 11:25:34.202448 24554 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: acquiring CA information for follower catalog manager: success
I20260812 11:25:34.203518 24554 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d9628feca5c24540aaf0c6a1ee190584: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:25:34.363157 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:34.359627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56108 (local address 127.12.175.253:41017)
0812 11:25:34.359838 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:34.359842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:34.359861 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:25:34.359996 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:34.359998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:34.360123 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:34.360232 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:34.360434 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.360971 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.361768 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.362016 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.362111 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:34.362399 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:34.362836 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:34.362931 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:34.362980 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 11:25:34.363030 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":64,"threads_started":1}
I20260812 11:25:34.369223 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:34.365961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43540 (local address 127.12.175.252:34903)
0812 11:25:34.366162 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:34.366166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:34.366179 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:25:34.366250 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:34.366252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:34.366348 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:34.366431 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:34.366613 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.367111 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.368001 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.368238 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.368308 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:34.368517 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:34.368894 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:34.368973 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:34.369037 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 11:25:34.369086 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260812 11:25:34.375679 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:34.371753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.12.175.253:41017)
0812 11:25:34.371856 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:34.371860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:34.372071 (+ 211us) server_negotiation.cc:407] Connection header received
0812 11:25:34.372259 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:34.372262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:34.372307 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:34.372347 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:34.372690 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.373329 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.374397 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.374728 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.374819 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:34.375154 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:34.375229 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:34.375335 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:34.375504 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 11:25:34.375559 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:25:34.376173 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:34.372232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43556 (local address 127.12.175.252:34903)
0812 11:25:34.372325 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:34.372328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:34.372544 (+ 216us) server_negotiation.cc:407] Connection header received
0812 11:25:34.372649 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:34.372652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:34.372699 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:34.372777 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:34.373130 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.373871 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.374956 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.375252 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.375345 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:34.375713 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:34.375779 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:34.375854 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:34.376013 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 11:25:34.376062 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:25:34.376782 24712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:34.371828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.12.175.254:45317)
0812 11:25:34.372353 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:34.372358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:34.372371 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:25:34.372467 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:34.372470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:34.372619 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:34.372781 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:34.373012 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.373845 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.374809 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:34.375051 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:34.375183 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:34.375478 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:34.375808 (+ 330us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:34.376549 (+ 741us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:34.376585 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 11:25:34.376645 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":84,"threads_started":1}
I20260812 11:25:34.379520 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 23990
I20260812 11:25:34.398741 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24138
I20260812 11:25:34.408420 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24295
2026-08-12T11:25:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3184 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:25:34 dist-test-slave-gjrz krb5kdc[24720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:25:34 dist-test-slave-gjrz krb5kdc[24720](info): set up 2 sockets
Aug 12 11:25:34 dist-test-slave-gjrz krb5kdc[24720](info): commencing operation
krb5kdc: starting...
W20260812 11:25:35.611646 12991 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/test-user.keytab.
Aug 12 11:25:35 dist-test-slave-gjrz krb5kdc[24720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:25:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:25:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
Entry for principal kudu/127.12.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab.
I20260812 11:25:35.723696 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:44281
--webserver_interface=127.12.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44281,127.12.175.253:45921,127.12.175.252:40703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:25:35.827816 24740 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:25:35.828039 24740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:35.828059 24740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:35.828107 24740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:35.831876 24740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:35.831918 24740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:35.831934 24740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:35.831948 24740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:35.831967 24740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:35.836805 24740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44281,127.12.175.253:45921,127.12.175.252:40703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.254.keytab
--principal=kudu/127.12.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.254:44281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:35.837595 24740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:35.838469 24740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:35.846042 24754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:35.846048 24757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:35.846225 24740 server_base.cc:1034] running on GCE node
W20260812 11:25:35.846055 24751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:35.846818 24740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:35.847867 24740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:35.849025 24740 hybrid_clock.cc:648] HybridClock initialized: now 1786533935849005 us; error 29 us; skew 500 ppm
Aug 12 11:25:35 dist-test-slave-gjrz krb5kdc[24720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:35.851526 24740 init.cc:377] Logged in from keytab as kudu/127.12.175.254@KRBTEST.COM (short username kudu)
I20260812 11:25:35.852296 24740 webserver.cc:460] Webserver started at http://127.12.175.254:33699/ using document root <none> and password file <none>
I20260812 11:25:35.852828 24740 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:35.852898 24740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:35.853083 24740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:35.854918 24740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data/instance:
uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb"
format_stamp: "Formatted at 2026-08-12 11:25:35 on dist-test-slave-gjrz"
server_key: "d51b9e5d440ab3df65ecee69ef406805"
server_key_iv: "6bb77fe25439b74202cb4b39f1ebff32"
server_key_version: "encryptionkey@0"
I20260812 11:25:35.855487 24740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal/instance:
uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb"
format_stamp: "Formatted at 2026-08-12 11:25:35 on dist-test-slave-gjrz"
server_key: "d51b9e5d440ab3df65ecee69ef406805"
server_key_iv: "6bb77fe25439b74202cb4b39f1ebff32"
server_key_version: "encryptionkey@0"
I20260812 11:25:35.858883 24740 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:25:35.861207 24778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:35.862396 24740 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:25:35.862506 24740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal
uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb"
format_stamp: "Formatted at 2026-08-12 11:25:35 on dist-test-slave-gjrz"
server_key: "d51b9e5d440ab3df65ecee69ef406805"
server_key_iv: "6bb77fe25439b74202cb4b39f1ebff32"
server_key_version: "encryptionkey@0"
I20260812 11:25:35.862599 24740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:35.878293 24740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:35.880717 24740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:35.880874 24740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:35.887110 24740 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.254:44281
I20260812 11:25:35.887379 24891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.254:44281 every 8 connection(s)
I20260812 11:25:35.887991 24740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/data/info.pb
I20260812 11:25:35.888505 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24740
I20260812 11:25:35.888626 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-0/wal/instance
I20260812 11:25:35.888886 12991 external_mini_cluster.cc:1428] Setting key ff31b4776e2099f54fc6c443c56a422f
I20260812 11:25:35.890597 24892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:35.894073 24892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.253@KRBTEST.COM" created.
Aug 12 11:25:35 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:35.907804 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:35.896016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44281 (local address 127.0.0.1:41542)
0812 11:25:35.896441 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:35.896490 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:35.897290 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:35.897913 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:35.897917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:35.898266 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:35.898504 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:35.898517 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:35.899667 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:35.899670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:35.900558 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:35.900570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:35.901197 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:35.901201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:35.901306 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:35.901856 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:35.901872 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:35.903172 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:35.905290 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:35.905299 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:35.905306 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:35.905516 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:35.905849 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:35.905851 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:35.905852 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:35.905944 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:35.906609 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:35.906614 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:35.906720 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 11:25:35.906844 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 11:25:35.907063 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":108,"threads_started":1}
I20260812 11:25:35.907809 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:35.896017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41542 (local address 127.12.175.254:44281)
0812 11:25:35.896517 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:35.896530 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:35.896577 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:25:35.897566 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:35.897571 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:35.897754 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:35.897901 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:35.898628 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:35.899549 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:35.900684 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:35.901047 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:35.901169 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:35.903359 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:35.903367 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:35.903381 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:35.903411 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:35.905187 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:35.905619 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:35.905625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:35.905627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:35.905765 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:35.906022 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:35.906024 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:35.906026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:35.906504 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:35.906645 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:35.906952 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 11:25:35.907172 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":388,"thread_start_us":133,"threads_started":1}
I20260812 11:25:35.911877 24892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:35.913491 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:35.913012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52776)
0812 11:25:35.913259 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:35.913386 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:25:35.913990 24784 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
I20260812 11:25:35.916723 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:35.916150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52778)
0812 11:25:35.916449 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:35.916577 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260812 11:25:35.917183 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:45921: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab.
Entry for principal kudu/127.12.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab.
I20260812 11:25:35.920065 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:45921
--webserver_interface=127.12.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab
--principal=kudu/127.12.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44281,127.12.175.253:45921,127.12.175.252:40703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:25:35.966729 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } attempt: 1
I20260812 11:25:35.969013 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:35.968026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52792)
0812 11:25:35.968419 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:35.968650 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260812 11:25:35.971336 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:35.970644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52800)
0812 11:25:35.970925 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:35.971062 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260812 11:25:35.971686 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:45921: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
I20260812 11:25:36.040148 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } attempt: 2
I20260812 11:25:36.042784 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.041924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52808)
0812 11:25:36.042336 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.042518 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 11:25:36.045032 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.044336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52814)
0812 11:25:36.044680 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.044810 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260812 11:25:36.045485 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:45921: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
I20260812 11:25:36.137040 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } attempt: 3
I20260812 11:25:36.139114 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.138403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52822)
0812 11:25:36.138645 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.138833 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 11:25:36.141034 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.140648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52834)
0812 11:25:36.140823 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.140923 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:25:36.141389 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:45921: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
W20260812 11:25:36.242367 24904 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:25:36.243199 24904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:36.243347 24904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:36.243531 24904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:25:36.254251 24904 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:36.254508 24904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:36.254652 24904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:36.254786 24904 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:36.254848 24904 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:36.267689 24904 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44281,127.12.175.253:45921,127.12.175.252:40703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.253.keytab
--principal=kudu/127.12.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.253:45921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:36.269654 24904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:36.272604 24904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:25:36.284610 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } attempt: 4
I20260812 11:25:36.286558 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.285863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52840)
0812 11:25:36.286328 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.286423 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258}
I20260812 11:25:36.287716 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.287179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52848)
0812 11:25:36.287473 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.287567 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 11:25:36.288096 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.253:45921: Network error: Client connection negotiation failed: client connection to 127.12.175.253:45921: connect: Connection refused (error 111)
W20260812 11:25:36.293226 24923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:36.293263 24919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:36.293815 24915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:36.294754 24904 server_base.cc:1034] running on GCE node
I20260812 11:25:36.296022 24904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:36.298671 24904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:36.302062 24904 hybrid_clock.cc:648] HybridClock initialized: now 1786533936301929 us; error 139 us; skew 500 ppm
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:36.308466 24904 init.cc:377] Logged in from keytab as kudu/127.12.175.253@KRBTEST.COM (short username kudu)
I20260812 11:25:36.310578 24904 webserver.cc:460] Webserver started at http://127.12.175.253:40089/ using document root <none> and password file <none>
I20260812 11:25:36.311934 24904 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:36.312099 24904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:36.312577 24904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:36.318149 24904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data/instance:
uuid: "43d6bffb3a1543f092980ace24361f70"
format_stamp: "Formatted at 2026-08-12 11:25:36 on dist-test-slave-gjrz"
server_key: "0725493d4bcacbb83f2e25cbb212ce73"
server_key_iv: "ccb2daf5ce18d889903c94203b09da2d"
server_key_version: "encryptionkey@0"
I20260812 11:25:36.319573 24904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal/instance:
uuid: "43d6bffb3a1543f092980ace24361f70"
format_stamp: "Formatted at 2026-08-12 11:25:36 on dist-test-slave-gjrz"
server_key: "0725493d4bcacbb83f2e25cbb212ce73"
server_key_iv: "ccb2daf5ce18d889903c94203b09da2d"
server_key_version: "encryptionkey@0"
I20260812 11:25:36.329310 24904 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.007s sys 0.001s
I20260812 11:25:36.336491 24935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:36.340113 24904 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.006s sys 0.000s
I20260812 11:25:36.340339 24904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal
uuid: "43d6bffb3a1543f092980ace24361f70"
format_stamp: "Formatted at 2026-08-12 11:25:36 on dist-test-slave-gjrz"
server_key: "0725493d4bcacbb83f2e25cbb212ce73"
server_key_iv: "ccb2daf5ce18d889903c94203b09da2d"
server_key_version: "encryptionkey@0"
I20260812 11:25:36.340628 24904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:25:36.407105 24904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:36.410974 24904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:36.411216 24904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:36.421406 24904 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.253:45921
I20260812 11:25:36.421738 25021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.253:45921 every 8 connection(s)
I20260812 11:25:36.422673 24904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/data/info.pb
I20260812 11:25:36.427031 25024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:36.427973 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 24904
I20260812 11:25:36.428170 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-1/wal/instance
I20260812 11:25:36.428740 12991 external_mini_cluster.cc:1428] Setting key 2d0f631761e0e19215040fe19838e459
I20260812 11:25:36.436748 25024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.175.252@KRBTEST.COM" created.
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:36.466146 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.441124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41554 (local address 127.12.175.254:44281)
0812 11:25:36.441523 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.441527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.444481 (+ 2954us) server_negotiation.cc:407] Connection header received
0812 11:25:36.447843 (+ 3362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.447870 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.448140 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.448465 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.451589 (+ 3124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.452359 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.454398 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.454717 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.454835 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.458415 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.458421 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.458430 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.458467 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.461700 (+ 3233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.462573 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.462579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.462581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.462934 (+ 353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.463661 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.463667 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.463669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.464244 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.464446 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.465353 (+ 907us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.465777 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":139,"threads_started":1}
I20260812 11:25:36.467918 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.442740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44281 (local address 127.0.0.1:41554)
0812 11:25:36.444188 (+ 1448us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.444292 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.446873 (+ 2581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.449072 (+ 2199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.449089 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.450129 (+ 1040us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.451330 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.451348 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.452497 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.452500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.454240 (+ 1740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.454252 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.454918 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.454929 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.455239 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.455996 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.456023 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.458127 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.461872 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.461889 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.461900 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.462374 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.463185 (+ 811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.463188 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.463189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.463493 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.464425 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.464438 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.464807 (+ 369us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.465168 (+ 361us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.465954 (+ 786us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":446,"threads_started":1}
I20260812 11:25:36.470163 25024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab.
Entry for principal kudu/127.12.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab.
I20260812 11:25:36.474774 12991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
/tmp/dist-test-taskNqPwv8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:40703
--webserver_interface=127.12.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab
--principal=kudu/127.12.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.175.212:42959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.175.254:44281,127.12.175.253:45921,127.12.175.252:40703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:36.484515 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.470795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52860)
0812 11:25:36.470942 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.470964 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.471137 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.471826 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.471830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.472096 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.472250 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.472256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.473659 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.473668 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.474516 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.474538 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.475895 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.475899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.476010 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.476669 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.476689 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.478688 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.481929 (+ 3241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.481936 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.481938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.482219 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.482670 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.482672 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.482673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.482767 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.483660 (+ 893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.483664 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.483817 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.483999 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.484232 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:25:36.485354 25037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.470905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52860 (local address 127.12.175.253:45921)
0812 11:25:36.471319 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.471337 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.471364 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:25:36.471424 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.471429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.471674 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.471843 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.472393 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.473488 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.474690 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.475720 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.475927 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.478843 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.478864 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.478874 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.478911 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.481766 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.482349 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.482364 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.482367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.482529 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.482883 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.482893 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.482895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.483450 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.484846 (+ 1396us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.484992 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.485171 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":135,"threads_started":1}
I20260812 11:25:36.488055 25024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:36.488951 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.488560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59318)
0812 11:25:36.488720 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.488846 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 11:25:36.489212 24937 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
I20260812 11:25:36.490324 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.489993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59334)
0812 11:25:36.490155 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.490231 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:25:36.490571 25024 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
I20260812 11:25:36.539841 25024 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 1
I20260812 11:25:36.540762 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.540442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59346)
0812 11:25:36.540596 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.540673 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 11:25:36.541622 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.541365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59350)
0812 11:25:36.541486 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.541547 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:25:36.541750 25024 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
I20260812 11:25:36.587401 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } attempt: 5
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:36.599977 25037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.588139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52868 (local address 127.12.175.253:45921)
0812 11:25:36.588293 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.588303 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.588438 (+ 135us) server_negotiation.cc:407] Connection header received
0812 11:25:36.588624 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.588628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.588696 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.588797 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.589378 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.590554 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.591705 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.592039 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.592199 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.595553 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.595562 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.595564 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.595601 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.597628 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.598421 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.598424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.598425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.598530 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.598974 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.598978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.598979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.599212 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.599373 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.599776 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.599869 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:25:36.600096 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.588132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52868)
0812 11:25:36.588335 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.588357 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.588498 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.588848 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.588853 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.589109 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.589238 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.589250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.590714 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.590718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.591536 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.591552 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.592189 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.592203 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.592386 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.593052 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.593067 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.595366 (+ 2299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.597781 (+ 2415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.597786 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.597788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.598262 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.598648 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.598651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.598654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.598822 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.599366 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.599370 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.599571 (+ 201us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.599736 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.599884 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 11:25:36.601119 24892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:25:36.601984 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.601701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59352)
0812 11:25:36.601830 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.601907 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 11:25:36.602736 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.602488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59368)
0812 11:25:36.602609 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.602667 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 11:25:36.602895 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
I20260812 11:25:36.609905 25024 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 2
I20260812 11:25:36.610597 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.610335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59384)
0812 11:25:36.610461 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.610521 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:25:36.611387 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.611112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59394)
0812 11:25:36.611231 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.611319 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 11:25:36.611509 25024 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
W20260812 11:25:36.651433 25038 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:25:36.651800 25038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:25:36.651856 25038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:25:36.651950 25038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 11:25:36.654065 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 1
I20260812 11:25:36.655069 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.654595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59408)
0812 11:25:36.654855 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.654944 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 11:25:36.656018 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.655710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59414)
0812 11:25:36.655843 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.655923 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:25:36.656198 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
W20260812 11:25:36.657627 25038 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:25:36.657683 25038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:25:36.657716 25038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:25:36.657749 25038 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:25:36.657774 25038 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:25:36.664304 25038 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.175.212:42959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.175.254:44281,127.12.175.253:45921,127.12.175.252:40703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/krb5kdc/kudu_127.12.175.252.keytab
--principal=kudu/127.12.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.175.252:40703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 10:26:14 UTC on ccycloud.quasar-hqgckh.root.comops.site
build id 4582280
I20260812 11:25:36.665563 25038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:25:36.666868 25038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:25:36.677798 25048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:25:36.677906 25049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:36.678048 25038 server_base.cc:1034] running on GCE node
W20260812 11:25:36.677809 25052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:25:36.678877 25038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:25:36.680459 25038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:25:36.681643 25038 hybrid_clock.cc:648] HybridClock initialized: now 1786533936681594 us; error 63 us; skew 500 ppm
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:25:36.685295 25038 init.cc:377] Logged in from keytab as kudu/127.12.175.252@KRBTEST.COM (short username kudu)
I20260812 11:25:36.686407 25038 webserver.cc:460] Webserver started at http://127.12.175.252:45825/ using document root <none> and password file <none>
I20260812 11:25:36.687084 25038 fs_manager.cc:359] Metadata directory not provided
I20260812 11:25:36.687186 25038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:25:36.687516 25038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:25:36.690301 25038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data/instance:
uuid: "bd9ded6db6c34054ab4989950f208acf"
format_stamp: "Formatted at 2026-08-12 11:25:36 on dist-test-slave-gjrz"
server_key: "21fb0ce77f714d580e0119b019d8ca1a"
server_key_iv: "b3ee0167d4a58590e39b3f06276e5fc4"
server_key_version: "encryptionkey@0"
I20260812 11:25:36.691208 25038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal/instance:
uuid: "bd9ded6db6c34054ab4989950f208acf"
format_stamp: "Formatted at 2026-08-12 11:25:36 on dist-test-slave-gjrz"
server_key: "21fb0ce77f714d580e0119b019d8ca1a"
server_key_iv: "b3ee0167d4a58590e39b3f06276e5fc4"
server_key_version: "encryptionkey@0"
I20260812 11:25:36.698056 25038 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:25:36.701987 25074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:25:36.702663 25024 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 3
I20260812 11:25:36.703572 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.703142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59424)
0812 11:25:36.703339 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.703426 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:25:36.704253 25038 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:25:36.704473 25038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data,/tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal
uuid: "bd9ded6db6c34054ab4989950f208acf"
format_stamp: "Formatted at 2026-08-12 11:25:36 on dist-test-slave-gjrz"
server_key: "21fb0ce77f714d580e0119b019d8ca1a"
server_key_iv: "b3ee0167d4a58590e39b3f06276e5fc4"
server_key_version: "encryptionkey@0"
I20260812 11:25:36.704644 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.704223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59434)
0812 11:25:36.704448 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.704539 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260812 11:25:36.704649 25038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 11:25:36.704864 25024 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
I20260812 11:25:36.723428 25038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:25:36.724398 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 2
I20260812 11:25:36.725358 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.724998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59442)
0812 11:25:36.725174 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.725256 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:25:36.726466 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.726048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59454)
0812 11:25:36.726248 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.726335 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 11:25:36.726677 24892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.175.252:40703: Network error: Client connection negotiation failed: client connection to 127.12.175.252:40703: connect: Connection refused (error 111)
I20260812 11:25:36.728103 25038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:25:36.728363 25038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:25:36.738817 25038 rpc_server.cc:307] RPC server started. Bound to: 127.12.175.252:40703
I20260812 11:25:36.739194 25176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.175.252:40703 every 8 connection(s)
I20260812 11:25:36.740335 25038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/data/info.pb
I20260812 11:25:36.744544 25178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:25:36.745163 12991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu as pid 25038
I20260812 11:25:36.745301 12991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNqPwv8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533654564615-12991-0/minicluster-data/master-2/wal/instance
I20260812 11:25:36.745730 12991 external_mini_cluster.cc:1428] Setting key 0bd126cd555b6772242b339a33f2e030
I20260812 11:25:36.751843 25178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
I20260812 11:25:36.767071 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.747589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59460 (local address 127.12.175.252:40703)
0812 11:25:36.748184 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.748219 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.748307 (+ 88us) server_negotiation.cc:407] Connection header received
0812 11:25:36.749379 (+ 1072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.749435 (+ 56us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.750208 (+ 773us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.750795 (+ 587us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.751887 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.754012 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.755596 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.756290 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.756451 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.760297 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.760308 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.760324 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.760364 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.762788 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.763486 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.763492 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.763503 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.763654 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.764043 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.764046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.764047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.764571 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.764885 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.765339 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.765745 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":135,"threads_started":1}
I20260812 11:25:36.768491 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.754534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41558 (local address 127.12.175.254:44281)
0812 11:25:36.754709 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.754713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.755126 (+ 413us) server_negotiation.cc:407] Connection header received
0812 11:25:36.755370 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.755374 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.755458 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.755594 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.757487 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.758485 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.760066 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.760453 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.760561 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.763758 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.763761 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.763763 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.763792 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.765816 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.766485 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.766497 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.766498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.766642 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.767074 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.767085 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.767087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.767449 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.767698 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.768211 (+ 513us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.768355 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:25:36.769480 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.754429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.254:44281 (local address 127.0.0.1:41558)
0812 11:25:36.754947 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.755028 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.755199 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.756684 (+ 1485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.756689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.757135 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.757311 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.757318 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.758647 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.758650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.759914 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.759929 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.760599 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.760605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.760777 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.761348 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.761377 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.763603 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.765992 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.766006 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.766017 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.766321 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.766796 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.766801 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.766803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.766920 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.767697 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.767711 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.767904 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.768130 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.768371 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":187,"threads_started":1}
I20260812 11:25:36.770884 25178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.254@KRBTEST.COM
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:36.782200 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.771569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.253:45921 (local address 127.0.0.1:52878)
0812 11:25:36.772021 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.772032 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.772114 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.772414 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.772416 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.772577 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.772696 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.772708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.773645 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.773648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.774459 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.774475 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.774975 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.774978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.775072 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.775639 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.775656 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.777547 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.779836 (+ 2289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.779839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.779840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.780144 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.780602 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.780605 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.780607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.780748 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.781393 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.781396 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.781556 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.781811 (+ 255us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.782003 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377}
I20260812 11:25:36.782218 25037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.771654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52878 (local address 127.12.175.253:45921)
0812 11:25:36.771806 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.771810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.772096 (+ 286us) server_negotiation.cc:407] Connection header received
0812 11:25:36.772216 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.772220 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.772298 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.772410 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.772834 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.773508 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.774604 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.774878 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.774962 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.777724 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.777728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.777730 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.777764 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.779686 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.780272 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.780276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.780278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.780447 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.780895 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.780898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.780899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.781223 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.781392 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.781932 (+ 540us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.782067 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:25:36.782513 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.770376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41566 (local address 127.12.175.254:44281)
0812 11:25:36.770521 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.770531 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.770571 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:25:36.770805 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.770809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.770881 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.771007 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.771945 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.772744 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.773680 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.773962 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.774073 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.777185 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.777189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.777192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.777231 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.779426 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.780073 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.780087 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.780089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.780203 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.780632 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.780635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.780643 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.780978 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.782025 (+ 1047us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.782144 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.782289 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:25:36.783366 25178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.252@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.175.253@KRBTEST.COM
I20260812 11:25:36.794354 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.783924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59468)
0812 11:25:36.784313 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.784323 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.784389 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.784691 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.784694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.784919 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.785067 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.785081 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.786274 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.786277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.787323 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.787340 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.787963 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.787966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.788042 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.788632 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.788651 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.790321 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.792578 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.792581 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.792588 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.792848 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.793166 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.793169 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.793178 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.793277 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.793714 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.793717 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.793820 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.793967 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.794150 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318}
I20260812 11:25:36.794400 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.784198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59468 (local address 127.12.175.252:40703)
0812 11:25:36.784344 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.784355 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.784368 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:25:36.784501 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.784507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.784571 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.784658 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.785203 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.786148 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.787473 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.787834 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.787970 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.790492 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.790497 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.790500 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.790535 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.792454 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.792969 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.792975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.792976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.793065 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.793378 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.793382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.793383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.793595 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.793731 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.794034 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.794234 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":59}
I20260812 11:25:36.795665 25037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.783996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52882 (local address 127.12.175.253:45921)
0812 11:25:36.784147 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.784151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.784173 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:25:36.784256 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.784259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.784319 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.784435 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.785421 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.786365 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.787665 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.788053 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.788180 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.791507 (+ 3327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.791512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.791522 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.791561 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.793315 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.793813 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.793816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.793818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.793921 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.794252 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.794256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.794258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.794515 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.794832 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.795258 (+ 426us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.795461 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:25:36.798591 25178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: Bootstrap starting.
I20260812 11:25:36.799479 12991 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:25:36.805063 25178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:36.801542 24838 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41566
I20260812 11:25:36.808977 25178 log.cc:824] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:36.815789 25178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: No bootstrap required, opened a new log
I20260812 11:25:36.824481 25178 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.825042 25178 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9ded6db6c34054ab4989950f208acf, State: Initialized, Role: FOLLOWER
I20260812 11:25:36.825843 25178 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.827411 25190 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:36.827765 25190 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:36.829455 25178 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:36.832867 24892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 3
W20260812 11:25:36.840987 25214 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:36.841117 25214 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:36.835705 25038 master_runner.cc:186] Error getting master registration for 127.12.175.254:44281: OK, instance_id { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" instance_seqno: 1786533935885451 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:25:36.843052 25038 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.254@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:25:36.848053 25024 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } attempt: 4
I20260812 11:25:36.857740 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.833845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59476 (local address 127.12.175.252:40703)
0812 11:25:36.834087 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.834092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.834115 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:25:36.834165 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.834174 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.834249 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.834420 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.835579 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.837427 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.844767 (+ 7340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.845087 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.845254 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.849529 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.849544 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.849557 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.849613 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.854180 (+ 4567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.854954 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.854960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.854962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.855100 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.855576 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.855586 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.855588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.856016 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.856268 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.857063 (+ 795us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.857389 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:25:36.857719 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.833470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59476)
0812 11:25:36.833678 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.833701 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.833841 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.834444 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.834454 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.834763 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.835133 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.835181 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.843078 (+ 7897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.843087 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.844567 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.844592 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.845252 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.845259 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.845403 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.846136 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.846161 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.849144 (+ 2983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.854338 (+ 5194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.854347 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.854350 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.854776 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.855237 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.855246 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.855248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.855439 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.856500 (+ 1061us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.856539 (+ 39us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.856729 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.856910 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.857239 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
Aug 12 11:25:36 dist-test-slave-gjrz krb5kdc[24720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.175.253@KRBTEST.COM for kudu/127.12.175.252@KRBTEST.COM
I20260812 11:25:36.869146 24892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb: Bootstrap starting.
I20260812 11:25:36.874022 25217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.848758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59482 (local address 127.12.175.252:40703)
0812 11:25:36.849200 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.849209 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.849235 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:25:36.849300 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.849322 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.849499 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.849719 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.851034 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.853548 (+ 2514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.854865 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.855757 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.856043 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.862017 (+ 5974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.862028 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.862031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.862072 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.868292 (+ 6220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.869786 (+ 1494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.869789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.869790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.869894 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.870426 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.870451 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.870453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.871529 (+ 1076us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.871686 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.872770 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.873221 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":145,"threads_started":1}
I20260812 11:25:36.875753 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.848646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.175.252:40703 (local address 127.0.0.1:59482)
0812 11:25:36.848833 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 11:25:36.848856 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:25:36.848991 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:25:36.849768 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:25:36.849781 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:25:36.850360 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:25:36.850650 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.850715 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.853765 (+ 3050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.853775 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.854666 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:25:36.854685 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.856018 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.856024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:25:36.856250 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.858337 (+ 2087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:25:36.858422 (+ 85us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:25:36.861826 (+ 3404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:25:36.868626 (+ 6800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.868630 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.868632 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.869642 (+ 1010us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.870001 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:25:36.870004 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:25:36.870006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:25:36.870245 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:25:36.871845 (+ 1600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:25:36.871849 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:25:36.872118 (+ 269us) client_negotiation.cc:769] Sending connection context
0812 11:25:36.872504 (+ 386us) client_negotiation.cc:240] Negotiation successful
0812 11:25:36.874879 (+ 2375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:25:36.885449 25024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: Bootstrap starting.
I20260812 11:25:36.886709 24892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:36.890134 24892 log.cc:824] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:36.895012 25024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: Neither blocks nor log segments found. Creating new log.
I20260812 11:25:36.897249 25024 log.cc:824] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: Log is configured to *not* fsync() on all Append() calls
I20260812 11:25:36.898360 24892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb: No bootstrap required, opened a new log
I20260812 11:25:36.902956 25024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: No bootstrap required, opened a new log
I20260812 11:25:36.913252 25024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.913254 24892 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.913869 25024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43d6bffb3a1543f092980ace24361f70, State: Initialized, Role: FOLLOWER
I20260812 11:25:36.913869 24892 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d0fc1bcaac4d7c9e1d7b0292de9afb, State: Initialized, Role: FOLLOWER
I20260812 11:25:36.915223 25024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.915258 24892 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.916332 25229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:36.916877 25229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:36.917598 24892 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:36.917629 25024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:25:36.917694 24838 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:25:36.917850 24838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:36.919802 24838 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.923230 24984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "43d6bffb3a1543f092980ace24361f70"
I20260812 11:25:36.923614 24984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:25:36.925717 24984 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94d0fc1bcaac4d7c9e1d7b0292de9afb in term 1.
I20260812 11:25:36.926483 25128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bd9ded6db6c34054ab4989950f208acf"
I20260812 11:25:36.926781 25128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:25:36.926919 25267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:36.926993 25267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:36.927953 24784 leader_election.cc:302] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43d6bffb3a1543f092980ace24361f70, 94d0fc1bcaac4d7c9e1d7b0292de9afb; no voters:
I20260812 11:25:36.928840 25128 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94d0fc1bcaac4d7c9e1d7b0292de9afb in term 1.
I20260812 11:25:36.929670 24838 leader_election.cc:288] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [CANDIDATE]: Term 1 election: Requested vote from peers 43d6bffb3a1543f092980ace24361f70 (127.12.175.253:45921), bd9ded6db6c34054ab4989950f208acf (127.12.175.252:40703)
I20260812 11:25:36.931082 25270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:25:36.931552 25270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [term 1 LEADER]: Becoming Leader. State: Replica: 94d0fc1bcaac4d7c9e1d7b0292de9afb, State: Running, Role: LEADER
I20260812 11:25:36.932300 25270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } }
I20260812 11:25:36.935323 25270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94d0fc1bcaac4d7c9e1d7b0292de9afb. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:36.935616 25270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: This master's current role is: LEADER
W20260812 11:25:36.941349 25266 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:25:36.941627 25266 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:25:36.942440 25287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:25:36.921345 25232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:36.942830 25232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:36.943771 24740 master_runner.cc:263] No leader master found from master 94d0fc1bcaac4d7c9e1d7b0292de9afb
I20260812 11:25:36.943972 24740 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:25:36.946189 24904 master_runner.cc:263] No leader master found from master 43d6bffb3a1543f092980ace24361f70
I20260812 11:25:36.946478 24904 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:25:36.946681 25287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:25:36.976683 25217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.941928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59486 (local address 127.12.175.252:40703)
0812 11:25:36.942477 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.942482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.950468 (+ 7986us) server_negotiation.cc:407] Connection header received
0812 11:25:36.955856 (+ 5388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.955860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.955957 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.956060 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.957618 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.959012 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.961293 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.961987 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.962161 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.968094 (+ 5933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.968100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.968103 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.968185 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.971700 (+ 3515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.972687 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.972692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.972693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.972884 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:36.973433 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:36.973439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:36.973440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:36.973787 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:36.974026 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:36.975332 (+ 1306us) server_negotiation.cc:299] Negotiation successful
0812 11:25:36.975908 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236}
W20260812 11:25:36.980559 25087 tablet.cc:2369] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:25:36.985503 25128 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [term 1 FOLLOWER]: Refusing update from remote peer 94d0fc1bcaac4d7c9e1d7b0292de9afb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:36.986737 25232 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:36.986900 24984 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [term 1 FOLLOWER]: Refusing update from remote peer 94d0fc1bcaac4d7c9e1d7b0292de9afb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:25:36.990435 25232 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [LEADER]: Connected to new peer: Peer: permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:25:37.001595 25190 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94d0fc1bcaac4d7c9e1d7b0292de9afb. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:37.001801 25190 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:37.003022 25229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94d0fc1bcaac4d7c9e1d7b0292de9afb. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:37.003254 25229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:37.005975 25232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:37.006209 25232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:37.009409 25229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:37.009644 25229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:37.010989 25270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:37.011245 25270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb [sys.catalog]: This master's current role is: LEADER
I20260812 11:25:37.013415 25295 mvcc.cc:205] Tried to move back new op lower bound from 7317643005874614272 to 7317643005680586752. Current Snapshot: MvccSnapshot[applied={T|T < 7317643005874614272}]
I20260812 11:25:37.013599 25190 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d0fc1bcaac4d7c9e1d7b0292de9afb" member_type: VOTER last_known_addr { host: "127.12.175.254" port: 44281 } } peers { permanent_uuid: "43d6bffb3a1543f092980ace24361f70" member_type: VOTER last_known_addr { host: "127.12.175.253" port: 45921 } } peers { permanent_uuid: "bd9ded6db6c34054ab4989950f208acf" member_type: VOTER last_known_addr { host: "127.12.175.252" port: 40703 } } }
I20260812 11:25:37.013790 25190 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:25:37.013988 25296 mvcc.cc:205] Tried to move back new op lower bound from 7317643005874614272 to 7317643005680586752. Current Snapshot: MvccSnapshot[applied={T|T < 7317643005874614272}]
I20260812 11:25:37.017354 25037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.943065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52884 (local address 127.12.175.253:45921)
0812 11:25:36.943541 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.943545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.948381 (+ 4836us) server_negotiation.cc:407] Connection header received
0812 11:25:36.959650 (+ 11269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.959654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.959764 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.959858 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.962673 (+ 2815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.963964 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.969747 (+ 5783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.970481 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.970636 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:36.983611 (+ 12975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:36.983616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:36.983619 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:36.983680 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:36.989497 (+ 5817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:37.006480 (+ 16983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:37.006484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:37.006496 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:37.006697 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:37.015623 (+ 8926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:37.015637 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:37.015639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:37.016067 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:37.016344 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:37.016948 (+ 604us) server_negotiation.cc:299] Negotiation successful
0812 11:25:37.017134 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260812 11:25:37.018960 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:36.942104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41580 (local address 127.12.175.254:44281)
0812 11:25:36.942800 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:36.942805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:36.947167 (+ 4362us) server_negotiation.cc:407] Connection header received
0812 11:25:36.948662 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:36.948665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:36.948961 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:36.949152 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:36.965963 (+ 16811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.967331 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.971585 (+ 4254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:36.972172 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:36.972363 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:37.006997 (+ 34634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:25:37.007002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:25:37.007016 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:25:37.007057 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:25:37.014975 (+ 7918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:37.015816 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:37.015830 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:37.015833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:37.016006 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:25:37.016601 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:25:37.016611 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:25:37.016613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:25:37.016938 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:25:37.017126 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:37.018353 (+ 1227us) server_negotiation.cc:299] Negotiation successful
0812 11:25:37.018564 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412}
I20260812 11:25:37.023474 25298 mvcc.cc:205] Tried to move back new op lower bound from 7317643005874614272 to 7317643005680586752. Current Snapshot: MvccSnapshot[applied={T|T < 7317643005874614272}]
I20260812 11:25:37.026136 25287 catalog_manager.cc:1347] Generated new cluster ID: 3442ddd772ae485297a543e9031f53a4
I20260812 11:25:37.026226 25287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:25:37.077720 25287 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:25:37.080478 25287 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:25:37.112365 25287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94d0fc1bcaac4d7c9e1d7b0292de9afb: Generated new TSK 0
I20260812 11:25:37.114063 25287 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:25:37.171641 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.166434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52896 (local address 127.12.175.253:45921)
0812 11:25:37.166683 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.166691 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.169581 (+ 2890us) server_negotiation.cc:407] Connection header received
0812 11:25:37.170023 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.170037 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.170133 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.170271 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.171509 (+ 1238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52896: BlockingRecv error: recv got EOF from 127.0.0.1:52896 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:25:37.174232 25028 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.165414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41586 (local address 127.12.175.254:44281)
0812 11:25:37.165762 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.165767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.172479 (+ 6712us) server_negotiation.cc:407] Connection header received
0812 11:25:37.172703 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.172707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.172840 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.172927 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.173982 (+ 1055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41586: BlockingRecv error: recv got EOF from 127.0.0.1:41586 (error 108)
Metrics: {"server-negotiator.queue_time_us":154}
W20260812 11:25:37.177166 25217 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.168405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59496 (local address 127.12.175.252:40703)
0812 11:25:37.168667 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.168683 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.175462 (+ 6779us) server_negotiation.cc:407] Connection header received
0812 11:25:37.175829 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.175843 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.175928 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.176033 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.176956 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59496: BlockingRecv error: recv got EOF from 127.0.0.1:59496 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
W20260812 11:25:37.185541 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.182641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52898 (local address 127.12.175.253:45921)
0812 11:25:37.182871 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.182875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.183772 (+ 897us) server_negotiation.cc:407] Connection header received
0812 11:25:37.184166 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.184169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.184324 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.184431 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.185377 (+ 946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52898: BlockingRecv error: recv got EOF from 127.0.0.1:52898 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 11:25:37.194685 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.191647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52914 (local address 127.12.175.253:45921)
0812 11:25:37.191945 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.191964 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.192970 (+ 1006us) server_negotiation.cc:407] Connection header received
0812 11:25:37.193399 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.193414 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.193506 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.193623 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.194535 (+ 912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52914: BlockingRecv error: recv got EOF from 127.0.0.1:52914 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260812 11:25:37.203936 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.200855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.12.175.253:45921)
0812 11:25:37.201017 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.201021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.202306 (+ 1285us) server_negotiation.cc:407] Connection header received
0812 11:25:37.202680 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.202683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.202761 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.202858 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.203723 (+ 865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52928: BlockingRecv error: recv got EOF from 127.0.0.1:52928 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 11:25:37.214214 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.211689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52930 (local address 127.12.175.253:45921)
0812 11:25:37.211875 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.211879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.212703 (+ 824us) server_negotiation.cc:407] Connection header received
0812 11:25:37.212986 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.212990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.213110 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.213240 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.214034 (+ 794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52930: BlockingRecv error: recv got EOF from 127.0.0.1:52930 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:25:37.229491 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.226613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52932 (local address 127.12.175.253:45921)
0812 11:25:37.226788 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.226812 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.227902 (+ 1090us) server_negotiation.cc:407] Connection header received
0812 11:25:37.228248 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.228251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.228322 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.228412 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.229284 (+ 872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52932: BlockingRecv error: recv got EOF from 127.0.0.1:52932 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 11:25:37.253885 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.250385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52946 (local address 127.12.175.253:45921)
0812 11:25:37.250550 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.250555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.252104 (+ 1549us) server_negotiation.cc:407] Connection header received
0812 11:25:37.252578 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.252582 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.252678 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.252829 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.253662 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52946: BlockingRecv error: recv got EOF from 127.0.0.1:52946 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 11:25:37.293380 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.290903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.12.175.253:45921)
0812 11:25:37.291305 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.291310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.292390 (+ 1080us) server_negotiation.cc:407] Connection header received
0812 11:25:37.292606 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.292610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.292663 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.292716 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.293276 (+ 560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52956: BlockingRecv error: recv got EOF from 127.0.0.1:52956 (error 108)
Metrics: {"server-negotiator.queue_time_us":150}
W20260812 11:25:37.362036 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.360774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.12.175.253:45921)
0812 11:25:37.361098 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.361103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.361120 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:25:37.361223 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.361226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.361275 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.361344 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.361898 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52962: BlockingRecv error: recv got EOF from 127.0.0.1:52962 (error 108)
Metrics: {"server-negotiator.queue_time_us":234}
W20260812 11:25:37.493330 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.492137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52968 (local address 127.12.175.253:45921)
0812 11:25:37.492304 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.492309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.492460 (+ 151us) server_negotiation.cc:407] Connection header received
0812 11:25:37.492626 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.492630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.492682 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.492752 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.493207 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52968: BlockingRecv error: recv got EOF from 127.0.0.1:52968 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 11:25:37.752725 25037 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:25:37.751659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52976 (local address 127.12.175.253:45921)
0812 11:25:37.751816 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:37.751820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:37.751978 (+ 158us) server_negotiation.cc:407] Connection header received
0812 11:25:37.752099 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:37.752101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:37.752157 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:37.752228 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:25:37.752606 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52976: BlockingRecv error: recv got EOF from 127.0.0.1:52976 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:25:37.842788 25214 catalog_manager.cc:1259] Loaded cluster ID: 3442ddd772ae485297a543e9031f53a4
I20260812 11:25:37.842875 25214 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: loading cluster ID for follower catalog manager: success
I20260812 11:25:37.844705 25214 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: acquiring CA information for follower catalog manager: success
I20260812 11:25:37.845822 25214 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bd9ded6db6c34054ab4989950f208acf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:25:37.928321 25267 catalog_manager.cc:1259] Loaded cluster ID: 3442ddd772ae485297a543e9031f53a4
I20260812 11:25:37.928392 25267 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: loading cluster ID for follower catalog manager: success
I20260812 11:25:37.930195 25267 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: acquiring CA information for follower catalog manager: success
I20260812 11:25:37.931459 25267 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 43d6bffb3a1543f092980ace24361f70: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:25:38.270268 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:38.266839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52980 (local address 127.12.175.253:45921)
0812 11:25:38.267081 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:38.267086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:38.267117 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:25:38.267278 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:38.267282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:38.267420 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:38.267529 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:38.267731 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.268245 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.269011 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.269228 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.269294 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:38.269531 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:38.269960 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:38.270045 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:38.270099 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 11:25:38.270146 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":88,"threads_started":1}
I20260812 11:25:38.276490 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:38.273041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59512 (local address 127.12.175.252:40703)
0812 11:25:38.273283 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:38.273288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:38.273302 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:25:38.273394 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:38.273397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:38.273515 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:38.273613 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:38.273823 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.274321 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.275106 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.275381 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.275468 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:38.275755 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:38.276110 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:38.276215 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:38.276298 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 11:25:38.276350 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":68,"threads_started":1}
I20260812 11:25:38.282923 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:38.278969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52992 (local address 127.12.175.253:45921)
0812 11:25:38.279071 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:38.279075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:38.279519 (+ 444us) server_negotiation.cc:407] Connection header received
0812 11:25:38.279687 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:38.279691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:38.279743 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:38.279786 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:38.280222 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.280944 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.281902 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.282218 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.282309 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:38.282518 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:38.282591 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:38.282659 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:38.282743 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 11:25:38.282798 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:25:38.283115 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:38.279411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59520 (local address 127.12.175.252:40703)
0812 11:25:38.279501 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:38.279505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:38.279639 (+ 134us) server_negotiation.cc:407] Connection header received
0812 11:25:38.279752 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:38.279755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:38.279796 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:38.279853 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:38.280156 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.280912 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.281946 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.282206 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.282317 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:38.282642 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:38.282714 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:38.282775 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:38.282953 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 11:25:38.283004 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:25:38.283223 25458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:25:38.278974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41592 (local address 127.12.175.254:44281)
0812 11:25:38.279209 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:25:38.279214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:25:38.279439 (+ 225us) server_negotiation.cc:407] Connection header received
0812 11:25:38.279535 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:25:38.279537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:25:38.279691 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:25:38.279800 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:25:38.279993 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.280586 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.281608 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:25:38.281950 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:25:38.282043 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:25:38.282320 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:25:38.282608 (+ 288us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:25:38.282681 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:25:38.283033 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 11:25:38.283098 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260812 11:25:38.291394 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24740
I20260812 11:25:38.308645 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 24904
I20260812 11:25:38.321430 12991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNqPwv8/build/debug/bin/kudu with pid 25038
2026-08-12T11:25:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3915 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7099 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (283756 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST